THOMAS PYZDEK 


The 
Six Sigma 


Handbook 


Revised and Expanded 


A Complete Guide 
for Green Belts, Black Belts, 
and Managers at All Levels 


THOMAS PYZDEK 


McGraw-Hill 


New York Chicago San Francisco Lisbon London Madrid Mexico City Milan 
New Delhi San Juan Seoul Singapore Sydney Toronto 


The McGraw-Hill companies 


Copyright © 2003 by The McGraw-HII] Companies, Inc. All rights reserved. Manufactured in the United States of 
America. Except as permitted under the United States Copyright Act of 1976, no part of this publication may be 
reproduced or distributed in any form or by any means, or stored in a database or retrieval system, without the prior 
written permission of the publisher. 


0-07-141596-3 


The material in this eBook also appears in the print version of this title: 0-07-141015-5. 


All trademarks are trademarks of their respective owners. Rather than put a trademark symbol after every occur- 
rence of a trademarked name, we use names in an editorial fashion only, and to the benefit of the trademark 
owner, with no intention of infringement of the trademark. Where such designations appear in this book, they 
have been printed with initial caps. 


McGraw-Hill eBooks are available at special quantity discounts to use as premiums and sales promotions, or for 
use in corporate training programs. For more information, please contact George Hoare, Special Sales, at 
george_hoare@mcgraw-hill.com or (212) 904-4069. 


TERMS OF USE 


This is a copyrighted work and The McGraw-Hill Companies, Inc. (“McGraw-Hill”) and its licensors reserve all 
rights in and to the work. Use of this work is subject to these terms. Except as permitted under the Copyright Act 
of 1976 and the right to store and retrieve one copy of the work, you may not decompile, disassemble, reverse 
engineer, reproduce, modify, create derivative works based upon, transmit, distribute, disseminate, sell, publish 
or sublicense the work or any part of it without McGraw-Hill’s prior consent. You may use the work for your 
own noncommercial and personal use; any other use of the work is strictly prohibited. Your right to use the work 
may be terminated if you fail to comply with these terms. 


THE WORK IS PROVIDED “AS IS”. McGRAW-HILL AND ITS LICENSORS MAKE NO GUARANTEES 
OR WARRANTIES AS TO THE ACCURACY, ADEQUACY OR COMPLETENESS OF OR RESULTS TO BE 
OBTAINED FROM USING THE WORK, INCLUDING ANY INFORMATION THAT CAN BE ACCESSED 
THROUGH THE WORK VIA HYPERLINK OR OTHERWISE, AND EXPRESSLY DISCLAIM ANY WAR- 
RANTY, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO IMPLIED WARRANTIES OF 
MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. McGraw-Hill and its licensors do not 
warrant or guarantee that the functions contained in the work will meet your requirements or that its operation 
will be uninterrupted or error free. Neither McGraw-Hill nor its licensors shall be liable to you or anyone else for 
any inaccuracy, error or omission, regardless of cause, in the work or for any damages resulting therefrom. 
McGraw-Hill has no responsibility for the content of any information accessed through the work. Under no cir- 
cumstances shall McGraw-Hill and/or its licensors be liable for any indirect, incidental, special, punitive, conse- 
quential or similar damages that result from the use of or inability to use the work, even if any of them has been 
advised of the possibility of such damages. This limitation of liability shall apply to any claim or cause whatso- 
ever whether such claim or cause arises in contract, tort or otherwise. 


DOI: 10.1036/0071415963 


“7 Professional 


Want to learn more? 


We hope you enjoy this McGraw-Hill eBook! If you’d like more 
information about this book, its author, or related books and 
websites, please click here. 


444 


For more information about this title, click here. 


Contents 


Preface 
Introduction 


Part! Six Sigma Implementation and Management 


Chapter1 Building the Six Sigma Infrastructure 
What is Six Sigma? 
Why Six Sigma? 
The Six Sigma philosophy 
The change imperative 
Change agents and their effects on organizations 
Implementing Six Sigma 
Timetable 
Infrastructure 
Six Sigma deployment and management 
Six Sigma communication plan 
Six Sigma organizational roles and responsibilities 
Selecting the “Belts” 
Integrating Six Sigma and related initiatives 
Deployment to the supply chain 
Change agent compensation and retention 
Chapter 2 Six Sigma Goals and Metrics 
Attributes of good metrics 
Six Sigma versus traditional three sigma performance 
The balanced scorecard 
Measuring causes and effects 
Information systems 


Copyright 2003 by The McGraw-Hill Companies, Inc. Click Here for Terms of Use. 


iv Contents 


Customer perspective 
Internal process perspective 
Innovation and learning perspective 
Financial perspective 
Strategy deployment plan 
Information systems requirements 
Integrating Six Sigma with other information systems 
technologies 
OLAP, data mining, and Six Sigma 
Dashboard design 
Dashboards for scale data 
Dashboards for ordinal data 
Dashboards for nominal data 
Setting organizational key requirements 
Benchmarking 
Chapter 3 Creating Customer-Driven Organizations 
Elements of customer-driven organizations 
Becoming a customer- and market-driven enterprise 
Elements of the transformed organization 
Surveys and focus groups 
Strategies for communicating with customers and employees 
Surveys 
Focus groups 
Other customer information systems 
Calculating the value of retention of customers 
Complaint handling 
Kano model of customer expectations 
Customer expectations, priorities, needs, and “voice” 
Garden variety Six Sigma only addresses half of the Kano 
customer satisfaction model 
Quality function deployment (QFD) 
Data collection and review of customer expectations, needs, 
requirements, and specifications 
The Six Sigma process enterprise 
Examples of processes 
The source of conflict 
A resolution to the conflict 
Process excellence 
Using QFD to link Six Sigma projects to strategies 
The strategy deployment matrix 
Deploying differentiators to operations 


65 
67 
69 
70 
71 
74 


74 
7? 
7? 
81 
84 
87 
89 
91 
97 
97 
98 
98 
102 
102 
103 
113 
114 
116 
118 
119 
119 


120 
121 


123 
125 
126 
128 
129 
130 
132 
133 
136 


Contents Vv 

Deploying operations plans to projects 138 
Linking customer demands to budgets 140 
Structured decision-making 140 
Category importance weights 145 
Subcategory importance weights 146 
Global importance weights 147 
Chapter4 Training for Six Sigma 150 
Training needs analysis 150 
The strategic training plan 152 
Training needs of various groups 153 
Post-training evaluation and reinforcement 162 
Chapter5 Six Sigma Teams 167 
Six Sigma teams 167 
Process improvement teams 168 
Work groups 169 
Quality circles 169 
Other self-managed teams 170 
Team dynamics management, including conflict resolution 171 
Stages in group development 172 
Common problems 173 
Member roles and responsibilities 173 
Facilitation techniques 178 
When to use an outside facilitator 178 
Selecting a facilitator 178 
Principles of team leadership and facilitation 179 
Facilitating the group task process 181 
Facilitating the group maintenance process 182 
Team performance evaluation 182 
Team recognition and reward 184 
Chapter6 Selecting and Tracking Six Sigma Projects 187 
Choosing the right projects 188 
Customer value projects 188 
Shareholder value projects 189 
Other Six Sigma projects 189 
Analyzing project candidates 189 
Benefit-cost analysis 189 

A system for assessing Six Sigma projects 190 
Other methods of identifying promising projects 198 
Throughput-based project selection 201 
Multi-tasking and project scheduling 205 
Summary and preliminary project selection 208 


vi 


Contents 


Tracking Six Sigma project results 
Financial results validation 
Financial analysis 
Lessons learned capture and replication 


Part Il Six Sigma Tools and Techniques 


Chapter7 Introduction to DMAIC and Other Improvement 
Models 
DMAIC, DMADV and learning models 
Design for Six Sigma project framework 
Learning models 
PDCA 


Dynamic models of learning and adaptation 
The Define Phase 


Chapter8 Problem Solving Tools 
Process mapping 
Cycle time reduction through cross-functional process 
mapping 
Flow charts 
Check sheets 
Process check sheets 
Defect check sheets 
Stratified defect check sheets 
Defect location check sheets 
Cause and effect diagram check sheets 
Pareto analysis 
How to perform a Pareto analysis 
Example of Pareto analysis 
Cause and effect diagrams 
7M tools 
Affinity diagrams 
Tree diagrams 
Process decision program charts 
Matrix diagrams 
Interrelationship digraphs 
Prioritization matrices 
Activity network diagram 
Other continuous improvement tools 


208 
211 
212 
233 


235 


237 
237 
239 
241 
243 
245 


252 
252 


253 
254 
255 
256 
257 
257 
258 
259 
259 
259 
260 
261 
264 
264 
265 
265 
268 
268 
269 
273 
273 


Contents 


Vii 


The Measure Phase 


Chapter9 Basic Principles of Measurement 
Scales of measurement 
Reliability and validity of data 
Definitions 
Overview of statistical methods 
Enumerative versus analytic statistical methods 
Enumerative statistical methods 
Assumptions and robustness of tests 
Distributions 
Probability distributions for Six Sigma 
Statistical inference 
Hypothesis testing/Type I and Type II errors 
Principles of statistical process control 
Terms and concepts 
Objectives and benefits 
Common and special causes of variation 
Chapter 10 Measurement Systems Analysis 
R&R studies for continuous data 
Discrimination, stability, bias, repeatability, 
reproducibility, and linearity 
Gage R&R analysis using Minitab 
Output 
Linearity 
Attribute measurement error analysis 
Operational definitions 
Example of attribute inspection error analysis 
Respectability and pairwise reproducibility 
Minitab attribute gage R&R example 


The Analyze Phase 


Chapter 11 Knowledge Discovery 
Knowledge discovery tools 
Run charts 
Descriptive statistics 
Histograms 
Exploratory data analysis 
Establishing the process baseline 
Describing the process baseline 


277 
page 
280 
280 
283 
283 
287 
290 
291 
293 
310 
315 
318 
318 
319 
321 
325 
325 


325 
337 
338 
341 
346 
348 
350 
352 
356 


361 
361 
361 
368 
371 
381 
385 
387 


Vili Contents 


SIPOC 
Process for creating a SIPOC diagram 
SIPOC example 
Chapter 12 Statistical Process Control Techniques 
Statistical process control (SPC) 
Types of control charts 
average and range, average and sigma, control charts for 
individual measurements, control charts for proportion 
defective, control chart for count of defectives, control 
charts for average occurrences-per-unit, control charts 
for counts of occurrences-per unit 
Short-run SPC 
control chart selection, rational subgroup sampling, 
control charts interpretation 
EWMA 
EWMA charts 
SPC and automatic process control 
Minitab example of EWMA 
Chapter 13 Process Capability Analysis 
Process capability analysis (PCA) 
How to perform a process capability study 
Statistical analysis of process capability data 
Process capability indexes 
Interpreting capability indexes 
Example of capability analysis using normally distributed 
variables data 
Estimating process yield 
Rolled throughput yield and sigma level 
Normalized yield and sigma level 
Chapter 14 Statistical Analysis of Cause and Effect 
Testing common assumptions 
Continuous versus discrete data 
Independence assumption 
Normality assumption 
Equal variance assumption 
Regression and correlation analysis 
Scatter plots 
Correlation and regression 
Analysis of categorical data 
Chi-square, tables 


383 
389 
390 
393 
393 
393 


430 


453 
453 
465 


467 
467 
467 
471 
472 
473 


475 
484 
484 
487 
490 
490 
490 
492 
493 
496 
496 
496 
502 
514 
514 


Contents ix 
Logistic regression 516 
binary logistic regression, ordinal logistic regression, 
and nominal logistic regression 
Non-parametric methods 528 
Guidelines on when to use non-parametric tests 533 
Minitab’s nonparametric tests 
The Improve Phase 
Chapter 15 Managing Six Sigma Projects 534 
Useful project management tools and techniques 535 
Project planning 536 
Project charter 538 
Work breakdown structures 541 
Feedback loops 543 
Performance measures 544 
Gantt charts 544 
Typical DMAIC project tasks and responsibilities 545 
PERT-CPM-type project management systems 545 
Resources 552 
Resource conflicts 552 
Cost considerations in project scheduling 552 
Relevant stakeholders 556 
Budgeting 558 
Project management implementation 560 
Management support and organizational roadblocks 560 
Short-term (tactical) plans 565 
Cross-functional collaboration 566 
Continuous review and enhancement of quality process 567 
Documentation and procedures 568 
Chapter 16 Risk Assessment 571 
Reliability and safety analysis 571 
Reliability analysis 571 
Risk assessment tools 590 
Fault free analysis 591 
Safety analysis 591 
Failure mode and effect analysis (FMEA) 596 
FMEA process 57 
Statistical tolerancing 600 
Assumptions of formula 605 
Tolerance intervals 606 


Contents 


Chapter17 Design of Experiments (DOE) 607 
Terminology 608 
Definitions 608 
Power and sample size 610 
Example 610 
Design characteristics 610 
Types of design 611 
One-factor 614 
Examples of applying common DOE methods using software 616 
Two-way ANOVA with no replicates 617 
Two-way ANOVA with replicates 618 
Full and fractional factorial 621 
Empirical model building and sequential learning 624 
Phase 0: Getting your bearings 626 
Phase I: The screening experiment 627 
Phase II: Steepest ascent (descent) 631 
Phase III: The factorial experiment 633 
Phase IV: The composite design 636 
Phase V: Robust product and process design 640 

Data mining, artificial neural networks and virtual process 
mapping 644 
Example 646 


The Control Phase 


Chapter 18 Maintaining Control After the Project 649 
Business process control planning 649 
How will we maintain the gains made? 649 
Tools and techniques useful for control planning 651 
Using SPC for ongoing control 652 
Process control planning for short and small runs 655 
Strategies for short and small runs 655 
Preparing the short run process control plain (PCP) 656 
Process audit 658 
Selecting process control elements 658 

The single part process 660 
Other elements of the process control plan 661 
PRE-Control 661 
Setting up PRE-Control 662 


Using PRE-Control 663 


Contents xi 

Beyond DMAIC 
Chapter 19 Design for Six Sigma (DFSS) 665 
Preliminary steps 665 
Define 667 
Identify CTQs 667 
Beyond customer requirements— identifying “delighters” 667 
Using AHP to determine the relative importance ofthe CTQs 668 
Measure 670 
Measurement plan 671 
Analyze 671 
Using customer demands to make design decisions 674 
Using weighted CTQs in decision-making 678 
Pugh concept selection method 681 
Design 682 
Predicting CTQ performance 682 
Process simulation 685 
Virtual DOE using simulation software 699 
Design phase cross-references 703 
Verify 703 
Pilot run 704 
Transition to full-scale operations 704 
Verify phase cross-references 704 
Chapter 20 Lean Manufacturing and Six Sigma 705 
Introduction to Lean and muda 705 
What is value to the customer? 706 
Example: Weld dents 706 
The value definition 707 
Kinds of waste 708 
What is the value stream? 708 
Value stream mapping 710 
How do we make value flow? 711 
Example of Takt time calculation 712 
Spaghetti charts 712 
How do we make value flow at the pull of the customer? 713 
Tools to help improve flow 714 

5S; constraint management; level loading; pull 
systems; flexible process; lot size reduction 

How can we continue towards perfection? 716 
KAIZEN 717 
Becoming Lean: A tactical perspective 720 
Six Sigma and Lean 721 


Xii Contents 


Appendix 724 
Table 1—Glossary of basic statistical terms 724 
Table 2—Area under the standard normal curve 730 
Table 3—Critical values of the ¢-distribution 733 
Table 4—Chi-square distribution 735 
Table 5—F distribution (« = 1%) 738 
Table 6—F distribution (a = 5%) 740 
Table 7—Poisson probability sums 742 
Table 8—Tolerance interval factors 746 
Table 9—Durbin-Watson test bounds 750 
Table 10—y factors for computing AOQL 754 
Table 11—Control chart constants 755 
Table 12—Control chart equations 757 
Table 13—Table of d5 values 759 
Table 14—Power functions for ANOVA 761 
Table 15—Factors for short run control charts for 

individuals, X-bar, and R charts 770 


Table 16—Significant number of consecutive highest or 
lowest values from one stream of a multiple-stream 


process 772 

Table 17—Sample customer survey 773 
Table 18—Process o levels and equivalent PPM quality levels 777 
Table 19—Black Belt effectiveness certification 778 
Table 202—Green Belt effectiveness certification 791 
Table 2I—AHP using Microsoft Excel™ 804 
References 806 


Index 814 


444 


Preface 


First, a basic question: just what are organizations anyway? Why do they 
exist? Some experts believe that the reason organizations exist is because of the 
high cost of executing transactions in the marketplace. Within an organization 
we can reallocate resources without the need to negotiate contracts, formally 
transfer ownership of assets, and so on. No need for lawyers, the managers do 
things on their own authority. The question is: how should they do this? In the 
free market prices tell us how to allocate resources, but prices don’t exist inside 
of an organization. We must come up with some alternative. 

Transaction costs aside, organizations exist to serve constituencies. 
Businesses have shareholders or private owners. The equivalent for non-profits 
are contributors. Organizations also serve “customer” constituencies. In other 
words, they produce things that other people want. Businesses must produce 
things that people are willing and able to buy for their own benefit. Non-profits 
must produce things that contributors are willing and able to buy for the benefit 
of others. Both types of organizations must do one thing: create value. The out- 
put must be of greater value than the inputs needed to produce it. If the output 
serves the constituencies well, the organization is effective. If it creates added 
value with a minimum of resources, it is efficient. (It is a common misconcep- 
tion that non-profits don’t need to be efficient. But the only difference between 
a for-profit and a not-for-profit is that the “surplus” created by adding value is 
used for different purposes. A not-for-profit that produces negative value (ie., 
spends more for its output than contributors are willing to pay) will not survive 
any more than a business posting continuous losses.) Boards of directors evalu- 
ate the effectiveness and efficiency of management and have the authority and 
duty to direct and replace inefficient or ineffective managers. 
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Six Sigma’s role in all of this is to help management produce the maximum 
value while using minimum resources. It does this by rationalizing manage- 
ment. By this I mean that it applies scientific principles to processes and pro- 
ducts. By using the Six Sigma DMAIC* approach processes or products are 
improved in the sense that they are more effective, more efficient, or both. If 
no process or product exists, or if existing processes or products are deemed 
beyond repair, then design for Six Sigma (DFSS) methods are used to create 
effective and efficient processes or products. Properly applied, Six Sigma mini- 
mizes the negative impact of politics on the organization. Of course, in any 
undertaking involving human beings, politics can never be completely elimi- 
nated. Even in the best of Six Sigma organizations there will still be the occa- 
sional Six Sigma project where data-based findings are ignored because they 
conflict with the preconceived notions of a powerful figure in the organization. 
But this will be the exception rather than the rule. 

It should be obvious by now that I don’t view Six Sigma either as a panacea or 
as a mere tool. The companies that have successfully implemented Six Sigma 
are well-known, including GE, Allied Signal, Intuit, Boeing Satellite Systems, 
American Express and many others. But the picture isn’t entirely rosy, failures 
also exist, most notably Motorola, the company that invented Six Sigma.™™ 
Running a successful business is an extremely complicated undertaking and it 
involves much more than Six Sigma. Any organization that obsesses on Six 
Sigma to the exclusion of such things as radical innovation, solid financial man- 
agement, a keen eye for changing external factors, integrity in accounting, etc. 
can expect to find itself in trouble some day. Markets are akin to jungles, and 
much danger lurks. Six Sigma can help an organization do some things better, 
but there are places where Six Sigma doesn’t apply. I seriously doubt that Six 
Sigma would’ve helped Albert Einstein discover relativity or Mozart compose 
a better opera. Recognizing the limits of Six Sigma while exploiting its strengths 
is the job of senior leadership. 

If you are working in a traditional organization, deploying Six Sigma will 
rock your world. If you are a traditional manager, you will be knocked so far 
out of your comfort zone that you will literally lose sleep trying to figure out 
what’s happening. Your most cherished assumptions will be challenged by 
your boss, the accepted way of doing things will no longer do. A new full-time, 
temporary position will be created which has a single mission: change the orga- 


*Define, Measure, Analyze, Improve, Control. 


“Whether Six Sigma has anything to do with Motorola’s recent problems is hotly debated. But it is undeniable that Motorola 


relied heavily on Six sigma and that it has had difficulties in recent years. Still, Motorola is a fine company with a long and 


splendid history, and I expect to see it back on top in the not too distant future. 
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nization. People with the word “belt” in their job title will suddenly appear, 
speaking an odd new language of statistics and project management. What 
used to be your exclusive turf will be identified as parts of turf-spanning pro- 
cesses; your budget authority may be usurped by new “Process Owners.” The 
new change agents will prowl the hallowed halls of your department, continu- 
ously stirring things up as they poke here and peek there, uncovering ineffi- 
ciency and waste in places where you never dreamed improvement was 
possible. Your data will be scrutinized and once indispensable reports will be 
discontinued, leaving you feeling as if you’ve lost the star you use to naviage. 
New reports, mostly graphical, will appear with peculiar lines on them labeled 
“control limits” and “process mean.” You will need to learn the meaning of 
such terms to survive in the new organization; in some organizations you 
won't be eligible for advancement until you are a trained “belt.” In others, you 
won't even be allowed to stay. 

When done properly, the result of deploying Six Sigma is an organization 
that does a better job of serving owners and customers. Employees who adapt 
to the new culture are better paid and happier. The work environment is excit- 
ing and dynamic and change becomes a way of life. Decisions are based on rea- 
son and rationality, rather than on mysterious back-room politics. 

However, when done half-heartedly, Six Sigma (or any other improvement 
initiative) is a colossal waste of money and time. The message is clear: do it 
right, or don’t do it at all. 

It has been nearly two decades since Six Sigma began and the popularity of 
the approach continues to grow. As more and more firms adopt Six Sigma as 
their organizational philosophy, they also adapt it to their own unique circum- 
stances. Thus, Six Sigma has evolved. This is especially true in the way Six 
Sigma is used to operationalize the organization’s strategy. Inspired leaders, 
such as Jack Welch and Larry Bossidy, have incorporated Six Sigma into the fab- 
ric of their businesses and achieved results beyond the predictions of the most 
enthusiastic Six Sigma advocate. Six Sigma has also been expanded from merely 
improving existing processes to the design of new products and processes that 
start life at quality and performance levels near or above Six Sigma. Six Sigma 
has also been integrated with that other big productivity movement, Lean 
Manufacturing. In this second edition I attempt to capture these new develop- 
ments and show how the new Six Sigma works. 
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Introduction 


The goal of this book remains the same as for the first edition, namely, to pro- 
vide you with the comprehensive guidance and direction necessary to realize 
Six Sigma’s promise, while avoiding traps and pitfalls commonly encountered. 
In this book you will find a complete overview of the management and organiza- 
tion of Six Sigma, the philosophy which underlies Six Sigma, and those problem 
solving techniques and statistical tools most often used in Six Sigma. It is not 
intended to be an ASQ certification study guide, although it includes coverage 
of most of the topics included in the ASQ body of knowledge. Rather it is 
intended as a guide for champions, leaders, “belts,” team members and others 
interested in using the Six Sigma approach to make their organizations more 
efficient, more effective, or both. In short, it is a user’s manual, not a classroom 
textbook. 

Compared to the first edition, you will find less discussion of theory. I love 
theory, but Six Sigma is quite hard-nosed in its bottom-line emphasis and I 
know that serious practitioners are more interested in how to use the tools and 
techniques to obtain results than in the theory underlying a particular tool. 
(Of course, theory is provided to the extent necessary to understand the proper 
use and limitations of a given tool.) Minitab and other software are used exten- 
sively to illustrate how to apply statistical techniques in a variety of situations 
encountered during Six Sigma projects. I believe that one of the major differ- 
ences between Six Sigma and previous initiatives, such as TQM, is the integra- 
tion of powerful computer-based tools into the training. Many actual examples 
are used, making this book something of a practical guide based on the school 
of hard knocks. 

Several different constituencies can benefit from this book. To serve these 
constituents I separate the book into different parts. Part I is aimed at senior 
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leaders and those managers who are charged with developing strategies and 
deploying the Six Sigma systems within the organization. In Part I you will 
find a high level presentation of the philosophy behind Six Sigma, but I get 
down to the nuts and bolts very quickly. By this I mean identifying how Six 
Sigma will change the organization, and answer such questions as what are the 
new positions that will be created? What knowledge, skills, abilities and perso- 
nal attributes should those filling these positions possess? What personnel 
assessment criteria should be used, and how can these criteria be used to evalu- 
ate candidates? Do we need to formally test applicants? What are the specific 
responsibilities of people in the organization with respect to Six Sigma? 
Unless such issues are carefully considered and addressed, Six Sigma will fail. 
There’s no real point to training Black Belts, Green Belts, and other parts of 
the Six Sigma infrastructure if the supporting superstructure isn’t in place. 

Part I also addresses the issue of linking Six Sigma to the enterprise’s strategic 
goals and objectives. Six Sigma is not Management By Objectives, but MBO 
didn’t fail because it was an entirely bad idea. What was missing from MBO 
was an understanding that results are process-driven and the development of a 
resource pool and the building of an infrastructure that was dedicated to driving 
the change necessary to accomplish the objectives. With Six Sigma one doesn’t 
achieve objectives by directly manipulating results, but by changing the way 
things are done. The driving force behind this change are the “belts,” who are 
highly trained full- and part-time change agents. These people lead and support 
projects, and it is the projects that drive change. But not just any projects will 
do. Projects must be derived from the needs of the enterprise and its customers. 
This is accomplished via a rigorous flow-down process that starts at the top of 
the organization. In addition to describing the mechanisms that accomplish 
this linkage, Part I describes the importance of rewards and incentives to suc- 
cess. In short, Six Sigma becomes the way senior leaders reach their goals. 

Part II presents the tools and techniques of Six Sigma. Six Sigma provides 
an improvement framework known as Define-Measure-Analyze-Improve- 
Control (DMAIC), and I have elected to organize the technical material within 
the DMAIC framework. It is important to note that this isn’t always the best 
way to first learn these techniques. Indeed, as a consultant I find that the Black 
Belt trainee often needs to use tools from the improve or control phase while 
she is still working in the define or measure phase of her project. Also, 
DMAIC is often used to establish “tollgates” at the end of each phase to help 
with project tracking, but there is usually considerable back-and-forth move- 
ment between the phases as the project progresses and one often finds that a 
“closed gate” must be kept at least partially ajar. Still, DMAIC serves the impor- 
tant purpose of providing a context for a given tool and a structure for the 
change process. 
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The presentation of DMAIC is followed by design for Six Sigma (DFSS) 
principles and practices. The DFSS methodology focuses on the Define- 
Measure-Analyze-Design-Verify (DMADV) approach, which builds on the 
reader’s understanding of DMAIC. DFSS is used primarily when there is no 
process in existence, or when the existing process is to be completely redesigned. 

Finally, a chapter on Lean Manufacturing provides the reader with an over- 
view of this important topic and discusses its relationship to Six Sigma. 


DMAIC overview 


e The Define phase of the book covers process mapping and flowcharting, 
project charter development, problem solving tools, and the so-called 7M 
tools. 

e Measure covers the principles of measurement, continuous and discrete 
data, scales of measurement, an overview of the principles of variation, 
and repeatability-and-reproducibility (RR) studies for continuous and 
discrete data. 

e Analyze covers establishing a process base line, how to determine process 
improvement goals, knowledge discovery, including descriptive and 
exploratory data analysis and data mining tools, the basic principles of sta- 
tistical process control (SPC), specialized control charts, process capabil- 
ity analysis, correlation and regression analysis, analysis of categorical 
data, and non-parametric statistical methods. 

e Improve covers project management, risk assessment, process simula- 
tion, design of experiments (DOE), robust design concepts (including 
Taguchi principles), and process optimization. 

¢ Control covers process control planning, using SPC for operational 
control, and PRE-control. 


DFSS covers the DMADV framework for process design, statistical toleran- 
cing, reliability and safety, using simulation software to analyze variation and 
risk, and performing “virtual DOE” using simulation software and artificial 
neural networks. 

Lean covers the basic principles of Lean, Lean tools and techniques, and a 
framework for deployment. It also discusses the considerable overlap between 
Lean and Six Sigma and how to integrate the two related approaches to achieve 
process excellence. 


Six Sigma Implementation 
and Management 
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CHAPTER 


Building the Six Sigma 
Infrastructure 


WHAT IS SIX SIGMA? 


This section provides a 10,000 foot overview of Six Sigma. Subsequent sec- 
tions elaborate and provide additional information on tools and techniques. 

Six Sigma is a rigorous, focused and highly effective implementation of pro- 
ven quality principles and techniques. Incorporating elements from the work 
of many quality pioneers, Six Sigma aims for virtually error free business perfor- 
mance. Sigma, 6, is a letter in the Greek alphabet used by statisticians to mea- 
sure the variability in any process. A company’s performance is measured by 
the sigma level of their business processes. Traditionally companies accepted 
three or four sigma performance levels as the norm, despite the fact that these 
processes created between 6,200 and 67,000 problems per million opportunities! 
The Six Sigma standard of 3.4 problems per million opportunities* is a response 
to the increasing expectations of customers and the increased complexity of 
modern products and processes. 

If you’re looking for new techniques, don’t bother. Six Sigma’s magic isn’t in 
statistical or high-tech razzle-dazzle. Six Sigma relies on tried and true methods 
that have been around for decades. In fact, Six Sigma discards a great deal of 


*Statisticians note: the area under the normal curve beyond Six Sigma is 2 parts-per-billion. In calculating failure rates for Six 
Sigma purposes we assume that performance experienced by customers over the life of the product or process will be much 
worse than internal short-term estimates predict. To compensate, a “shift” of 1.5 sigma from the mean is added before calcu- 
lating estimated long-term failures. Thus, you will find 3.4 parts-per-million as the area beyond 4.5 sigma on the normal curve. 


Copyright 2003 by The McGraw-Hill Companies, Inc. Click Here for Terms of Use. 
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the complexity that characterized Total Quality Management (TQM). By one 
expert’s count, there were over 400 TQM tools and techniques. Six Sigma 
takes a handful of proven methods and trains a small cadre of in-house technical 
leaders, known as Six Sigma Black Belts, to a high level of proficiency in the 
application of these techniques. To be sure, some of the methods Black Belts 
use are highly advanced, including up-to-date computer technology. But the 
tools are applied within a simple performance improvement model known as 
Define-Measure-Analyze-Improve-Control, or DMAIC. DMAIC is described 
briefly as follows: 


D Define the goals of the improvement activity. 
M Measure the existing system. 
A Analyze the system to identify ways to eliminate the gap 


between the current performance of the system or 
P 
process and the desired goal. 


I Improve the system. 


C Control the new system. 


Why Six Sigma? 

When a Japanese firm took over a Motorola factory that manufactured 
Quasar television sets in the United States in the 1970s, they promptly set 
about making drastic changes in the way the factory operated. Under Japanese 
management, the factory was soon producing TV sets with 1/20" as many 
defects as they had produced under Motorola’s management. They did this 
using the same workforce, technology, and designs, and did it while lowering 
costs, making it clear that the problem was Motorola’s management. It took a 
while but, eventually, even Motorola’s own executives finally admitted “Our 
quality stinks” (Main, 1994). 

It took until nearly the mid-1980s before Motorola figured out what to do 
about it. Bob Galvin, Motorola’s CEO at the time, started the company on 
the quality path known as Six Sigma and became a business icon largely as a 
result of what he accomplished in quality at Motorola. Using Six Sigma 
Motorola became known as a quality leader and a profit leader. After 
Motorola won the Malcolm Baldrige National Quality Award in 1988 the 
secret of their success became public knowledge and the Six Sigma revolution 
was on. Today it’s hotter than ever. Even though Motorola has been struggling 
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the past few years, companies such as GE and AlliedSignal have taken up the 
Six Sigma banner and used it to lead themselves to new levels of customer ser- 
vice and productivity. 

It would be a mistake to think that Six Sigma is about quality in the tradi- 
tional sense. Quality, defined traditionally as conformance to internal require- 
ments, has little to do with Six Sigma. Six Sigma is about helping the 
organization make more money by improving customer value and efficiency. 
To link this objective of Six Sigma with quality requires a new definition of 
quality. For Six Sigma purposes I define quality as the value added by a pro- 
ductive endeavor. Quality comes in two flavors: potential quality and actual 
quality. Potential quality is the known maximum possible value added per 
unit of input. Actual quality is the current value added per unit of input. The 
difference between potential and actual quality is waste. Six Sigma focuses 
on improving quality (ie., reducing waste) by helping organizations produce 
products and services better, faster and cheaper. There is a direct correspon- 
dence between quality levels and “sigma levels” of performance. For example, 
a process operating at Six Sigma will fail to meet requirements about 3 times 
per million transactions. The typical company operates at roughly four 
sigma, which means they produce roughly 6,210 failures per million transac- 
tions. Six Sigma focuses on customer requirements, defect prevention, cycle 
time reduction, and cost savings. Thus, the benefits from Six Sigma go straight 
to the bottom line. Unlike mindless cost-cutting programs which also reduce 
value and quality, Six Sigma identifies and eliminates costs which provide no 
value to customers, waste costs. 

For non-Six Sigma companies, these costs are often extremely high. 
Companies operating at three or four sigma typically spend between 25 and 40 
percent of their revenues fixing problems. This is known as the cost of quality, 
or more accurately the cost of poor quality. Companies operating at Six Sigma 
typically spend less than 5 percent of their revenues fixing problems (Figure 
1.1). COPQ values shown in Figure 1.1 are at the lower end of the range of 
results reported in various studies. The dollar cost of this gap can be huge. 
General Electric estimated that the gap between three or four sigma and Six 
Sigma was costing them between $8 billion and $12 billion per year. 

One reason why costs are directly related to sigma levels is very simple: sigma 
levels are a measure of error rates, and it costs money to correct errors. Figure 
1.2 shows the relationship between errors and sigma levels. Note that the error 
rate drops exponentially as the sigma level goes up, and that this correlates 
well to the empirical cost data shown in Figure 1.1. Also note that the errors 
are shown as errors per million opportunities, not as percentages. This is 
another convention introduced by Six Sigma. In the past we could tolerate per- 
centage error rates (errors per hundred opportunities), today we cannot. 
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Figure 1.1. Cost of poor quality versus sigma level. 


The Six Sigma philosophy 
Six Sigma is the application of the scientific method to the design and opera- 
tion of management systems and business processes which enable employees 
to deliver the greatest value to customers and owners. The scientific method 
works as follows: 
1. Observe some important aspect of the marketplace or your business. 
2. Develop a tentative explanation, or hypothesis, consistent with your 
observations. 
Based on your hypothesis, make predictions. 

4. Test your predictions by conducting experiments or making further 
careful observations. Record your observations. Modify your hypothesis 
based on the new facts. If variation exists, use statistical tools to help 
you separate signal from noise. 

5. Repeat steps 3 and 4 until there are no discrepancies between the hypoth- 
esis and the results from experiments or observations. 

At this point you have a viable theory explaining an important relationship in 
your market or business. The theory is your crystal ball, which you can use to 
predict the future. As you can imagine, a crystal ball is a very useful thing to 
have around. Furthermore, it often happens that your theory will explain things 
other than the thing you initially studied. Isaac Newton’s theory of gravity 
may have begun with the observation that apples fell towards the earth, but 
Newton’s laws of motion explained a great deal about the way planets moved 
about the sun. By applying the scientific method over a period of years you will 
develop a deep understanding of what makes your customer and your business 
tick. 


» 
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Figure 1.2. Error rate versus sigma level. 


In Six Sigma organizations this approach is applied across the board. The 
result is that political influence is minimized and a “show me the data” attitude 
prevails. Not that corporate politics are eliminated, they can never be where 
human beings interact. But politics are much less an influence in Six Sigma orga- 
nizations than in traditional organizations. People are often quite surprised at 
the results of this seemingly simple shift in attitude. The essence of these results 
is stated quite succinctly by “Pyzdek’s Law”: 


Most of what you know is wrong! 


Like all such “laws,” this is an overstatement. However, you'll be stunned by 
how often people are unable to provide data supporting their positions on 
basic issues when challenged to do so. For example, the manager of a technical 
support call center was challenged by the CEO to show that customers cared 
deeply about hold time. When he looked into it the manager found that custo- 
mers cared more about the time it took to reach a technician and whether or 
not their issue was resolved. The call center’s information system was measur- 
ing hold time not only as the time until the technician first answered the 
phone, but also the time the customer was on hold while the technician 
researched the answer to the call. The customer cared much less about this 
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“hold time” because it helped with the resolution of the issue. This fundamental 
change in focus made a great deal of difference in the way the call center oper- 
ated. 


What we know 

We all know that there was a surge in births nine months after the November 
1965 New York City power failure, right? After all, the New York Times said so 
in a story that ran August 8, 1966. If that’s not prestigious enough for you, con- 
sider that the source quoted in the Times article was the city’s Mt. Sinai 
Hospital, one of the best. 


What the data show 

The newspaper compared the births on August 8, 1965 with those on August 
8, 1966. This one-day comparison did indeed show an increase year-over-year. 
However, J. Richard Udry, director of the Carolina Population Center at the 
University of North Carolina, studied birthrates at several New York City hos- 
pitals between July 27 and August 14, 1966. His finding: the birthrate nine 
months after the blackout was slightly below the five-year average. 


The Six Sigma philosophy focuses the attention of everyone on the stakeholders 
for whom the enterprise exists. It is a cause-and-effect mentality. Well-designed 
management systems and business processes operated by happy employees 
cause customers and owners to be satisfied or delighted. Of course, none of 
this is new. Most leaders of traditional organizations honestly believe that this 
is what they already do. What distinguishes the traditional approach from Six 
Sigma is the degree of rigor. 


JUST DOIT! 


Six Sigma organizations are not academic institutions. They compete in the 
fast-paced world of business and they don’t have the luxury of taking years to 
study all aspects of a problem before deciding on a course of action. A valuable 
skill for the leader of a Six Sigma enterprise, or for the sponsor of a Six Sigma 
project, is to decide when enough information has been obtained to warrant tak- 
ing a particular course of action and moving on. Six Sigma leadership is very 
hard-nosed when it comes to spending the shareholder’s dollars and project 
research tends to be tightly focused on delivering information useful for man- 
agement decision-making. Once a level of confidence is achieved, management 
must direct the Black Belt to move the project from the Analyze phase to the 
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Improve phase, or from the Improve phase to the Control phase. Projects are 
closed and resources moved to new projects as quickly as possible. 

Six Sigma organizations are not infallible, they make their share of mistakes 
and miss some opportunities they might have found had they taken time to 
explore more possibilities. Still, they make fewer mistakes than their traditional 
counterparts and scholarly research has shown that they perform significantly 
better in the long run. 


WHAT'S IMPORTANT? 


While working with an aerospace client, I was helping an executive set up a 
system for identifying potential Six Sigma projects in his area. I asked “What 
are your most important metrics? What do you focus on?” “That’s easy,” he 
responded. “We just completed our monthly ops review so I can show you.” 

He then called his secretary and asked that she bring the ops review copies. 
Soon the secretary came in lugging three large, loose-leaf binders filled with 
copies of PowerPoint slides. This executive and his staff spend one very long 
day each month reviewing all of these metrics, hoping to glean some direction 
to help them plan for the future. This is ot focusing, it’s torture! 

Sadly, this is not an isolated case. Over the years P've worked with thousands 
of people in hundreds of companies and this measurement nightmare is com- 
monplace, even typical. The human mind isn’t designed to make sense of such 
vast amounts of data. Crows can track three or four people, beyond that they 
lose count.* Like crows, we can only hold a limited number of facts in our 
minds at one time. We are simply overwhelmed when we try to retain too 
much information. One study of information overload found the following 
(Waddington, 1996): 

¢ Two-thirds of managers report tension with work colleagues, and loss of 

job satisfaction because of stress associated with information overload. 

¢ One-third of managers suffer from ill health, as a direct consequence of 

stress associated with information overload. This figure increases to 43% 
among senior managers. 

¢ Almost two-thirds (62%) of managers testify that their personal relation- 

ships suffer as a direct result of information overload. 

¢ 43% of managers think important decisions are delayed, and the ability to 

make decisions is affected as a result of having too much information. 

e 44% believe the cost of collating information exceeds its value to business. 


*See Joe Wortham, “Corvus brachyhynchos,” http://www.usd.edu/~jwortham/corvus/corvus.html. 
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Clearly, more information isn’t always better. 

When pressed, nearly every executive or manager will admit that there are 
a half-dozen or so measurements that really matter. The rest are either deriva- 
tives or window dressing. When asked what really interested him, my client 
immediately turned to a single slide in the middle of one of the binders. 
There were two “Biggies” that he focused on. The second-level drill down 
involved a half-dozen major drivers. Tracking this number of metrics is well 
within the abilities of humans, if not crows! With this tighter focus the execu- 
tive could put together a system for selecting good Six Sigma projects and 
team members. 

Six Sigma activities focus on the few things that matter most to three key con- 
stituencies: customers, shareholders, and employees. The primary focus is on 
customers, but shareholder interests are not far behind. The requirements of 
these two groups are determined using scientific methods, of course. But the 
science of identifying what people want is not fully mature, so the data are sup- 
plemented with a great deal of personal contact at all levels of the organization. 
Employee requirements are also aggressively sought. Well-treated employees 
stay longer and do a better job. 


DOCUMENTED BENEFITS 


Focus comes from two perspectives: down from the top-level goals and up 
from problems and opportunities. The opportunities meet the goals at the Six 
Sigma project. Six Sigma projects link the activities of the enterprise to its 
improvement goals. The linkage is so tight that in a well-run enterprise people 
working on Six Sigma projects can tell you which enterprise objectives will be 
impacted by their project, and senior leaders are able to measure the impact of 
Six Sigma on the enterprise in clear and meaningful terms. The costs and bene- 
fits of Six Sigma are monitored using enterprise-wide tracking systems that can 
slice and dice the data in many different ways. At any point in time an executive 
can determine if Six Sigma is pulling its weight. In many TQM programs of the 
past people were unable to point to specific bottom-line benefits, so interest gra- 
dually waned and the programs were shelved when times got tough. Six Sigma 
organizations know precisely what they’re getting for their investment. 

Six Sigma also has an indirect benefit on an enterprise, and one that is sel- 
dom measured. That benefit is its impact on the day-to-day way of doing 
things. Six Sigma doesn’t operate in a vacuum. When people observe Six 
Sigma getting dramatic results, they naturally modify the way they approach 
their work. Seat-of-the-pants management doesn’t sit well (pardon the pun!) 
in Six Sigma organizations that have reached “critical mass.” Critical mass 
occurs when the organization’s culture has changed as a result of Six Sigma 
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being successfully deployed in a large segment of the organization. The initial 
clash of cultures has worked itself out and those opposed to the Six Sigma 
way have either left, converted, or learned to keep quiet. 

There is also a “dark side” to Six Sigma that needs to be discussed. There are 
parts of the enterprise that don’t lend themselves to scientific rigor. For exam- 
ple, successful R&D involves a good deal of original creative thinking. The 
“R” (research) part of R&D may actually suffer from too much rigor and the 
Six Sigma focus on defects. Cutting edge research is necessarily trial and error 
and requires a high tolerance for failure. The chaos of exploring new ideas is 
not something to be managed out of the system, it is to be expected and encour- 
aged. To the extent that it involves process design and product testing, Six 
Sigma may be able to make a contribution to the “D” (development) part of 
R&D. The point is to selectively apply Six Sigma to those areas where it will 
provide a benefit. 

A second aspect of Six Sigma’s dark side is that some companies obsess on it 
to the exclusion of other important aspects of the business. Business is a com- 
plex undertaking and leading a business enterprise requires creativity, innova- 
tion, and intuition. While it’s all well and good to be “data driven,” leaders 
need to heed their inner voice as well. Keep in mind that some of the most 
important things are unmeasured and immeasurable. Challenge counterintui- 
tive data and subject it to a gut check. It may be that the counterintuitive result 
represents a startling breakthrough in knowledge, but it may simply be wrong. 

Here’s an example. A software client had a technical support call center to 
help their customers solve problems with the software. Customer surveys were 
collected and the statistician made an amazing discovery; hold time didn’t mat- 
ter! The data showed that customer satisfaction was the same for customers 
served immediately and for those on hold for an hour or more. Discussions 
began along the lines of how many fewer staff would be required due to this 
new information. Impressive savings were forecast. 

Fortunately, the support center manager hadn’t left his skepticism at the 
front door. He asked for additional data, which showed that the abandon rate 
increased steadily as people were kept on hold. The surveys were given only to 
those people who had waited for service. These people didn’t mind waiting. 
Those who hung up the phone before being served apparently did. In fact, 
when a representative sample was obtained, excessive hold time was the number 
one complaint. 


The change imperative 


Six Sigma is not a completely new way to manage an enterprise, but itzs a very 
different way. In essence, Six Sigma forces change to occur in a systematic way. 
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In traditional organizations the job of management is to design systems to cre- 
ate and deliver value to customers and shareholders. This is, of course, a never- 
ending task. Competitors constantly innovate in an attempt to steal your custo- 
mers. Customers continuously change their minds about what they want. 
Capital markets offer investors new ways to earn a return on their investment. 
The result is an imperative to constantly change management systems. 

Despite the change imperative, most enterprises resist change until there are 
obvious signs that current systems are failing one or more stakeholder groups. 
Perhaps declining market share makes it clear that your products or services are 
not as competitive as they once were. Or maybe your customers are still loyal, 
but customer complaints have reached epidemic proportions. Or your share 
price may be trending ominously downward. Traditional organizations watch 
for such signs and react to them. Change occurs, as it must, but it does so in an 
atmosphere of crisis and confusion. Substantial loss may result before the needed 
redesign is complete. People may lose their jobs or even their careers. Many orga- 
nizations that employ these reactionary tactics don’t survive the shock. 

The Six Sigma enterprise proactively embraces change by explicitly incor- 
porating change into their management systems. Full- and part-time change 
agent positions are created and a complete infrastructure is created. As contra- 
dictory as it sounds, the infrastructure is designed to make change part of the 
routine. New techniques are used to monitor changing customer, shareholder, 
and employee inputs, and to rapidly integrate the new information by changing 
business processes. The approach employs sophisticated computer modeling, 
mathematics, and statistical analysis to minimize unneeded tampering by separ- 
ating signal from noise. These analytical techniques are applied to stakeholder 
inputs and to enterprise and process metrics at all levels. 

As a consequence of deploying Six Sigma, people require a great deal of train- 
ing. Communication systems are among the first things that need to be changed 
so people know what to make of the new way of doing things. Think about it; 
when Six Sigma is deployed the old reports are no longer used. Six Sigma 
requires that internal data be presented only if there is a direct linkage to a stake- 
holder. The phrase “How do you know?” is heard repeatedly. 

e “Nice report on on-time deliveries, Joan, but show me why you think this 
is important to the customer. If it is, I want to see a chart covering the 
last 52 weeks, and don’t forget the control limits.” 

e “This budget variance report is worthless! I want to see performance 
across time, with control limits.” 

e “Have these employee survey results been validated? What is the reliabil- 
ity of the questions? What are the main drivers of employee satisfaction? 
How do you know?” 

e “How do your dashboards relate to the top-level dashboards?” 
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Add to this the need to do more than simply operate the system you work 
with. Six Sigma demands that you constantly look for ways to improve your sys- 
tems. This often means that systems are eliminated entirely. In the face of this 
insecurity, employees watch like a hawk for signs of leadership inconsistency. 
Trust is essential. Leaders who don’t communicate a clear and consistent 
message and walk the talk will be faced with stiff resistance to Six Sigma. 

The need for a well-designed approach to making the transition from a tradi- 
tional organization to a Six Sigma organization is clear. This is the subject of 
Part I of this book. It is the foundation building phase. If it isn’t done properly, 
then the DMAIC approach and all of the tools and techniques presented later 
in the book will be of little use. 


Change agents and their effects on organizations 
MANAGING CHANGE 


Experts agree: change is difficult, disruptive, expensive, and a major cause of 
error. Given these problems, it’s reasonable to ask: Why change? Here are the 
most common reasons organizations choose to face the difficulties involved 
with change: 

¢ Leadership—Some organizations choose to maintain product or service 
leadership as a matter of policy. Change is a routine. 

¢ Competition—When competitors improve their products or services 
such that their offering provides greater value than yours, you are forced 
to change. Refusal to do so will result in the loss of customers and revenues 
and can even lead to complete failure. 

¢ Technological advances—Effectively and quickly integrating new tech- 
nology into an organization can improve quality and efficiency and pro- 
vide a competitive advantage. Of course, doing so involves changing 
management systems. 

e Training requirements—Many companies adopt training programs 
without realizing that many such programs implicitly involve change. 
For example, a company that provides employees with SPC training 
should be prepared to implement a process control system. Failure to do 
so leads to morale problems and wastes training dollars. 

e Rules and regulations—Change can be forced on an organization from 
internal regulators via policy changes and changes in operating proce- 
dures. Government and other external regulators and rule-makers (eg., 
ISO for manufacturing, JCAHO for hospitals) can also mandate change. 

¢ Customer demands—Customers, large and small, have the annoying 
habit of refusing to be bound by your policies. The nice customers will 
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demand that you change your policy and procedures. The really nasty 
customers don’t say anything at all, they simply go somewhere else to do 
business. 


Johnson (1993b, p. 233) gives the following summary of change management: 


1. 
2: 


Change will meet resistance for many different reasons. 

Change is a balance between the stable environment and the need to 
implement TQM [Six Sigma]. Change can be painful while it provides 
many improvements. 

There are four times change can most readily be made by the leader: 
when the leader is new on the job, receives new training, has new tech- 
nology, or when outside pressures demand change. 

Leaders must learn to implement change they deem necessary, change 
suggested from above their level, and change demanded from above 
their level. 

There are all kinds of reaction to change. Some individuals will resist, 
some will accept, and others will have mixed reactions. 

There is a standard process that supports the implementation of change. 
Some of the key requirements for change are leadership, empathy, and 
solid communications. 

It is important that each leader become a change leader. This requires 
self-analysis and the will to change those things requiring change. 


ROLES 


Change requires new behaviors from everyone involved. However, four spe- 
cific roles commonly appear during most successful change processes 
(Hutton, 1994, pp. 2-4): 


Official change agent. An officially designated person who has primary 
responsibility for helping management plan and manage the change pro- 
cess [Sometimes called “Champions.” ] 

Sponsors. Sponsors are senior leaders with the formal authority to legit- 
imize the change. The sponsor makes the change a goal for the organi- 
zation and ensures that resources are assigned to accomplish it. No 
major change is possible without committed and suitably placed sponsors. 


e Advocate. An advocate for change is someone who sees a need for change 


and sets out to initiate the process by convincing suitable sponsors. This 
is a selling role. Advocates often provide the sponsor with guidance and 
advice. Advocates may or may not hold powerful positions in the organi- 
zation. 


¢ Informal change agent. Persons other than the official change agent who 


voluntarily help plan and manage the change process. While the contri- 
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bution of these people is extremely important, it is generally not sufficient 
to cause truly significant, organization-wide change. 
The position of these roles within a typical organizational hierarchy is illu- 
strated graphically in Figure 1.3. 


Sponsor 


Top 
management 
team 


team 


Figure 1.3. Cascading of sponsorship. 
From Hutton, D.W. (1994). The Change Agent’s Handbook: A Survival Guide for Quality 
Improvement Champions. Copyright © 1994 by David W. Hutton. 
Reprinted with permission. 


THE JOB OF CHANGE AGENT 
Goals 


There are three goals of change: 

1. Change the way people in the organization think. Helping people change 
the way they think is a primary activity of the change agent. All change 
begins with the individual, at a personal level. Unless the individual is will- 
ing to change his behavior, no real change is possible. Changing behavior 
requires a change in thinking. In an organization where people are 
expected to use their minds, people’s actions are guided by their thoughts 
and conclusions. The change agent’s job starts here. 

2. Change the norms. Norms consist of standards, models, or patterns 
which guide behavior in a group. All organizations have norms or expec- 
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tations of their members. Change cannot occur until the organization’s 
norms change. 

3. Change the organization’s systems or processes. This is the “meat” of the 
change. Ultimately, all work is a process and quality improvement 
requires change at the process and system level. However, this cannot 
occur on a sustained basis until individuals change their behavior and 
organizational norms are changed. 


Mechanisms used by change agents 

The change agents help accomplish the above goals in a variety of ways. 
Education and training are important means of changing individual perceptions 
and behaviors. In this discussion, a distinction is made between training and 
education. Training refers to instruction and practice designed to teach a person 
how to perform some task. Training focuses on concretes that need to be done. 
Education refers to instruction in how to think. Education focuses on integrat- 
ing abstract concepts into one’s knowledge of the world. An educated person 
will view the world differently after being educated than they did before. This 
is an essential part of the process of change. 

Change agents help organize an assessment of the organization to identify its 
strengths and weaknesses. Change is usually undertaken to either reduce areas 
of weakness, or exploit areas of strength. The assessment is part of the education 
process. Knowing one’s specific strengths and weaknesses is useful in mapping 
the process for change. 

Change agents play an important role in quality improvement (remember, 
“improvement” implies change). As shown in Figure 1.3, change agents are in 
strategic positions throughout the organization. This makes it possible for 
them to assist in the coordination of the development and implementation of 
quality improvement plans. Quality improvement of any significance nearly 
always involves multiple departments and levels in the organization. 

In the final analysis, all we humans really have to spend is our time. Change 
agents see to it that senior management spends sufficient time on the trans- 
formation process. Senior managers’ time is in great demand from a large num- 
ber of people inside and outside of the organization. It is all too easy to 
schedule a weekly meeting to discuss “Six Sigma” for an hour, then think you’ve 
done your part. In fact, transforming an organization, large or small, requires a 
prodigious commitment of the time of senior leadership. At times the executive 
will not understand what he or she is contributing by, say, attending team meet- 
ings. The change agent must constantly assure the leader that time spent on 
transformation activities is time well spent. 
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One way of maximizing the value of an executive’s time investment is for the 
executive to understand the tremendous power of certain symbolic events. 
Some events generate stories that capture the essence of management’s com- 
mitment (or lack of it) to the change being undertaken. People repeat stories 
and remember them far better than proclamations and statements. For exam- 
ple, there’s a story told by employees of a large U.S. automotive firm that goes 
as follows: 


In the early 1980s the company was just starting their quality improve- 
ment effort. At a meeting between upper management and a famous qual- 
ity consultant, someone casually mentioned that quality levels were 
seasonal—quality was worse in the summer months. The consultant 
asked why this should be so. Were different designs used? Were the 
machines different? How about the suppliers of raw materials? The 
answer to each of these questions was “No.” An investigation revealed 
that the problem was vacations. When one worker went on vacation, 
someone else did her job, but not quite as well. And that “someone” also 
vacated a job, which was done by a replacement, etc. It turned out that 
the one person going on vacation lead to six people doing jobs they did 
not do routinely. The solution was to have a vacation shutdown of two 
weeks. This greatly reduced the number of people on new jobs and 
brought summer quality levels up to the quality levels experienced the 
rest of the year. 

This worked fine for a couple of years since there was a recession in the 
auto industry and there was plenty of excess capacity. However, one sum- 
mer the senior executives were asked by the finance department to recon- 
sider their shutdown policy. Demand had picked up and the company 
could sell every car it could produce. The accountants pointed out that 
the shutdown would cost $100 million per day in lost sales. 

The vice president of the truck division asked if anything had been done 
to address the cause of the quality slippage in the summer. No, nothing 
had been done. The president asked the staff “If we go back to the old pol- 
icy, would quality levels fall like they did before?” Yes, he was told, they 
would. “Then we stay with our current policy and shut down the plants 
for vacations,” the President announced. 

The President was challenged by the vice president of finance. “I know 
we're committed to quality, but are you sure you want to lose $1.4 billion 
in sales just to demonstrate our commitment?” The President replied, 
“Frank, I’m not doing this to ‘demonstrate’ anything. We almost lost our 
company a few years back because our quality levels didn’t match our 
overseas competition. Looking at this as a $1.4 billion loss is just the kind 
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of short-term thinking that got us in trouble back then. I’m making this 
decision to save money.” 


This story had tremendous impact on the managers who heard it, and it 
spread like wildfire throughout the organization. It demonstrated many 
things simultaneously: senior leadership’s commitment to quality, political 
parity between operations and finance, how seemingly harmless policies 
can have devastating effects, an illustration of how short-term thinking had 
damaged the company in the past, and how long-term thinking worked in a 
specific instance, etc. It is a story worth 100 speeches and mission state- 
ments. 


Leadership support activities 

The change agent provides technical guidance to the leadership team. This 
guidance takes the form of presenting management with alternative strategies 
for pursuing the transformation, education on methods that can be used to 
implement the strategies, and selection of key personnel for key transformation 
jobs. 

Change agents help to monitor the status of quality teams and quality pro- 
jects relating to the transformation (see Chapter 15 for a complete discussion 
of project management). In addition to being a vehicle for local quality improve- 
ment, projects can be used as one of the mechanisms for actually implementing 
the transformation. If used in this way, it is important that projects be properly 
chartered to align the project activities with the goals of the transformation. 
All teams, chartered or not, must avoid projects and methods that conflict 
with the goals of the transformation. Project team membership must be care- 
fully planned to assure that both task and group maintenance roles are properly 
filled. Project charters must clearly identify the scope of the project to prevent 
the confusion between teams that results from overlapping charters. 

Change agents also serve as coaches to senior leaders. Culture involves innu- 
merable subtle characteristics and behaviors that become unconsciously 
“absorbed” into one’s being. At times, it is nearly impossible for the individual 
executive to see how his or her behavior or relationships are interpreted by 
others. The change agent must quietly advise leadership on these issues. 

The press of day-to-day business, combined with the inherent difficulties of 
change, make it easy to let time slip by without significant progress. Keeping 
operations going is a full-time job, and current problems present themselves 
with an urgency that meeting a future goal can’t match. Without the constant 
reminders from change agents that goals aren’t being met, the leadership can 
simply forget about the transformation. It is the change agent’s job to become 
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the “conscience” of the leadership and to challenge them when progress falls 
short of goals. 


Change networks 

Change agents should work to develop an internal support network. The net- 
work provides resources to support the change process by disseminating educa- 
tion and guidance. The network’s tasks will eventually be subsumed by normal 
operations, but in the early stages of the transformation it is vital that the net- 
work exist since the control of resources is determined by the existing infra- 
structure and may be difficult to divert to the change process. Usually, the 
members of the network are formal and informal change agents in various 
areas of the organization. 

Once the network has been established, it is the change agent’s job to assure 
that the activities in the network are consistent with and in support of the orga- 
nization’s vision. For example, if a hospital has a vision where physicians obtain 
real-time clinical information and decision support at the patient’s bedside, 
then a financially based and centralized information system is inconsistent 
with that vision. The change agent, especially the formal change agent, provides 
leadership and moral support to network members, who may otherwise feel iso- 
lated and vulnerable. Change agents ensure that members of the network 
receive the education and guidance they need. Finally, the change agent acts as 
a conduit and a stimulant to maintain regular communication in the network. 
This may take the form of setting up an email list, scheduling lunches for 
network members, etc. 


Transforming staff functions 

Table 1.1 illustrates the contrast between the way that staff functions used 
to operate under the traditional system of management, and the way they can 
operate more effectively. 

There are several ways in which change agents can assist staff functions in 
transforming their roles: 

¢ Collaborate with staff functions. 

e Encourage staff functions to take a proactive approach to change. 

¢ Make support functions partners in the support network. 

e Encourage staff members to become role models. 

e Help staff functions develop transition plans that are aligned and inte- 

grated with the overall transformation plan. 
e Encourage staff members to share their concerns. 
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Table 1.1. How staff functions are changing. 
From Hutton, D.W. (1994). The Change Agent’s Handbook: A Survival Guide for Quality 
Improvement Champions. Page 220. Copyright © 1994 by David W. Hutton. 
Reprinted with permission. 


FROM TO 
Role Customer—for information, Supplier—of information, 
evidence, and reports from expertise, and other services 
others 
Strategy Control—by imposition of Support—by gearing efforts 
policies and procedures, and by to the needs of others 
audit and inspection 
Self-control by client 
Goal Departmental—achievement of | Collective achievement of the 
departmental objectives organization’s objectives 
Style of working | Competitive, adversarial Integrating, collaborative 
with others 
Focus of Some aspects of outcomes; for The relationship between 
attention example, product quality, the entire underlying process 
financial results and the achievement of all 
the desired outcomes 
Some pieces of the process; for 
example, adherence to policy 
and procedure 
Image Regulator, inspector, policeman | Educator, helper, guide 


IMPLEMENTING SIX SIGMA 


After nearly two decades of experience with Six Sigma and TQM, there is 
now a solid body of scientific research regarding the experience of thousands 
of companies implementing major programs such as Six Sigma. Researchers 
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have found that successful deployment of Six Sigma involves focusing on a small 
number of high-leverage items. The steps required to successfully implement 
Six Sigma are well-documented. 


1. 


6. 


Successful performance improvement must begin with senior leader- 
ship. Start by providing senior leadership with training in the philoso- 
phy, principles, and tools they need to prepare their organization for 
success. Using their newly acquired knowledge, senior leaders direct 
the development of a management infrastructure to support Six Sigma. 
Simultaneously, steps are taken to “soft-wire” the organization and to 
cultivate an environment where innovation and creativity can flourish. 
This involves reducing levels of organizational hierarchy, removing pro- 
cedural barriers to experimentation and change, and a variety of other 
changes designed to make it easier to try new things without fear of 
reprisal. 

Systems are developed for establishing close communication with custo- 
mers, employees, and suppliers. This includes developing rigorous meth- 
ods of obtaining and evaluating customer, owner, employee, and 
supplier input. Base line studies are conducted to determine the starting 
point and to identify cultural, policy, and procedural obstacles to 
success. 

Training needs are rigorously assessed. Remedial basic skills educa- 
tion is provided to assure that adequate levels of literacy and numer- 
acy are possessed by all employees. Top-to-bottom training is 
conducted in systems improvement tools, techniques, and philoso- 
phies. 

A framework for continuous process improvement is developed, along 
with a system of indicators for monitoring progress and success. Six 
Sigma metrics focus on the organization’s strategic goals, drivers, and 
key business processes. 

Business processes to be improved are chosen by management, and by 
people with intimate process knowledge at all levels of the organization. 
Six Sigma projects are conducted to improve business performance 
linked to measurable financial results. This requires knowledge of the 
organization’s constraints. 

Six Sigma projects are conducted by individual employees and teams 
lead by Green Belts and assisted by Black Belts. 


Although the approach is simple, it is by no means easy. But the results jus- 
tify the effort expended. Research has shown that firms that successfully 
implement Six Sigma perform better in virtually every business category, 
including return on sales, return on investment, employment growth, and 
share price increase. 
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Timetable 


Six Sigma’s timeline is usually very aggressive. Typically, companies look for 
an improvement rate of approximately 10x every two years, measured in 
terms of mistakes or errors using defects per million opportunities (DPMO).* 
The subject of DPMO is treated in greater detail elsewhere in this book. For 
our purposes here, think of DPMO as the organization’s overall performance 
as observed by customers. While calculating this can become very complicated, 
for illustration we will look at a very simple example. Assume that you have 
the data on key processes in a technical support call center operation shown in 
Table 1.2. It is very important to understand that the requirements shown in 
this table are derived from customer input. For example, in Table 1.2, the 5 min- 
ute hold time requirement assumes that we have surveyed customers and 
found that they are willing to accept hold times of 5 minutes or less. Likewise, 
we have data to indicate that support engineers rated higher than 5 are accepta- 
ble to customers. “Problem resolved” means that the customer told us his 
problem was resolved. 

A Six Sigma program on a typical timetable would seek to reduce the overall 
DPMO from approximately 58,000 to about 5,800 in two years time. This 
would improve the sigma level from 3.1 to around 4.0 (see Figure 1.2). 
Remember, Six Sigma corresponds toa DPMO of 3.4, so there’s still a way to go. 


Table 1.2. Process defect rates. 


Calls Calls Meeting Sigma 
Process Element Handled Requirement DPMO Level 
Hold time 120,000 110,000 83,333 2.9 
<5 minutes 
SE rating > 5 119,000 118,000 8,403 3.9 
Problem resolved 125,000 115,000 80,000 2.9 
Total 364,000 343,000 57,692 3.1 


*This is about twice the rate of improvement reported by companies using TQM. For example, Baldrige winner Milliken & 


Co. implemented a “ten-four” improvement program requiring reductions in key adverse measures by a factor of ten every 


four years. 
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Years 


5.0 5 


4.8 4 


4.6 5 


44 4 


4.2 5 


4.0 4 


3.8 4 


3.6 4 


3.4 4 


3.2 4 


3.0 


The time needed to reach Six Sigma performance levels depends on the 
organization’s starting point and their level of commitment. Figure 1.4 pro- 
vides a rough guideline for determining when you will reach Six Sigma, 
assuming an aggressive deployment schedule. The times are only approxi- 
mate, your mileage may vary. Keep in mind that even if the enterprise is 
operating at, say, 5 or 6 Sigma overall, there may still be processes operating 
at poor sigma levels. Never forget that individual customers judge your 
organization based on their individual experiences with you. Relationships 
are made one person at a time. For our example, the company can expect 
it to take about five years from the time they have deployed Six Sigma to 
the time they begin to approach Six Sigma performance levels. If they follow 
the deployment timeline shown in Figure 1.4 it will be approximately 
seven years altogether. This is not to say that they’ll have to wait seven 
years to see results. Results will begin to appear within a year of starting 
the deployment. 


Time to Reach Six Sigma 


Assuming 10x Improvement Every Two Years 


3.00 


3.25 3.50 3.75 4.00 4.25 4.50 


Current Process Sigma Level 


Figure 1.4. Time to Reach Six Sigma performance levels. 
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DEPLOYMENT TIMELINE 


Obtaining these revolutionary rates of improvements will not come without 
concerted effort. An aggressive deployment plan must be developed. Figure 1.5 
shows a typical set of deployment activities and a timetable designed to reach 
maturity within two years. This is not to say that the enterprise will be finished 
in two years, nor that all of its processes will be operating at Six Sigma perfor- 
mance levels. The organization is never finished! Competition, innovation, 
changing customer requirements and a host of other factors will assure that 
the quest for excellence is ongoing. However, if the enterprise completes the 
tasks depicted in Figure 1.5 the systems and infrastructure needed to keep 
them at the cutting edge will have been developed. 

The deployment timetable shown in Figure 1.5 will produce sufficient sav- 
ings to cover its costs during the first year. In the second and subsequent years 
the benefits will outpace the costs. The benefit-to-cost ratio will improve as 
time goes by. Figure 1.6 shows General Electric’s published data on their Six 
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Six Sigma Phase 4 


Alignment 
QEstablish Exec, Council 
Odire Consultant 
Olssue Ga Policy 
ODetated Planning 
DID Management Process 
OKnowedge Discovery 
OConduct Readiness Survey 


Program Development 
DEstabiish Project Validation 
Criteria 
OContinuing BB Training 
OID Master BBs 
OBegin to establish Six 
Sigma Practice 


Implementation Maturity 
Prepare detailed road map of 
next steps 
OTram Employees 
OTrain 2nd Wave Black Belts 
OTrain Additonal Green Belts 
QUID Additional Projects 


Figure 1.5. Typical deployment activities and timeline. 
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Costs (Millions) 


$2,500 + + $2,500 
$2,000 + + $2,000 
$1,500 + + $1,500 a 
6 
Benefits = 
a] 
3 
5 
$1,000 + + $1,000 9 
S50 Rs, oe Bee a eee eee ° + $500 
Take Pe Costs 
$0 ! $0 
1996 1997 1998 1999 
Figure 1.6. GE’s reported cost of Six Sigma versus benefits. 
Sigma program. Note that in 1996, the first full year of GE’s program, costs and 
benefits were approximately equal. The amount by which benefits exceed costs 
is increasing because, while costs level out, benefits continue to increase. These 
results are consistent with those reported by academic research for companies 
which implemented TQM. 
Infrastructure 


A very powerful feature of Six Sigma is the creation of an infrastructure to 
assure that performance improvement activities have the necessary resources. 
In this author’s opinion, failure to provide this infrastructure is a major reason 
why 80% of all TQM implementations failed in the past. TQM presented gen- 
eral principles and left it to each organization to decide how to put the princi- 
ples into practice. Companies that did an excellent job of operationalizing the 
principles of TQM obtained excellent results, comparable to the results 
reported by companies implementing Six Sigma. Those that didn’t, failed. Six 
Sigma provides a quasi-standardized set of guidelines for deployment. This is 
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why, I believe, Six Sigma enjoys a much higher success rate than TQM. Of 
course, there are still those companies that kludge together half-hearted efforts 
and call it Six Sigma. They will fail just as those who deployed half-baked 
TQM programs failed. 

Six Sigma makes improvement and change the full-time job of a small but cri- 
tical percentage of the organization’s personnel. These full-time change agents 
are the catalyst that institutionalizes change. Figure 1.7 illustrates the commit- 
ment required by Six Sigma. 


Assessing organization culture on quality 

Juran and Gryna (1993) define the company quality culture as the opinions, 
beliefs, traditions, and practices concerning quality. While sometimes difficult 
to quantify, an organization’s culture has a profound effect on the quality 
produced by that organization. Without an understanding of the cultural 
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Figure 1.7. Six Sigma infrastructure. 
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aspects of quality, significant and lasting improvements in quality levels are 
unlikely. 

Two of the most common means of assessing organization culture is the 
focus group and the written questionnaire. These two techniques are discussed 
in greater detail below. The areas addressed generally cover attitudes, percep- 
tions, and activities within the organization that impact quality. Because of the 
sensitive nature of cultural assessment, anonymity is usually necessary. The 
author believes that it is necessary for each organization to develop its own set 
of questions. The process of getting the questions is an education in itself. One 
method for getting the right questions that has produced favorable results in 
the past is known as the critical-incident technique. This involves selecting a 
small representative sample (7 ~ 20) from the group you wish to survey and 
asking open-ended questions, such as: 


“Which of our organization’s beliefs, traditions and practices have a 
beneficial impact on quality?” 

“Which of our organization’s beliefs, traditions and practices have a detri- 
mental impact on quality?” 


The questions are asked by interviewers who are unbiased and the respon- 
dents are guaranteed anonymity. Although usually conducted in person or 
by phone, written responses are sometimes obtained. The order in which the 
questions are asked (beneficial/detrimental) is randomized to avoid bias in 
the answer. Interviewers are instructed not to prompt the respondent in any 
way. It is important that the responses be recorded verbatim, using the 
respondent’s own words. Participants are urged to provide as many responses 
as they can; a group of 20 participants will typically produce 80-100 
responses. 

The responses themselves are of great interest and always provide a great deal 
of information. In addition, the responses can be grouped into categories and 
the categories examined to glean additional insight into the dimensions of the 
organization’s quality culture. The responses and categories can be used to 
develop valid survey items and to prepare focus-group questions. The follow- 
up activity is why so few people are needed at this stage—statistical validity is 
obtained during the survey stage. 


LEADERSHIP 


Six Sigma involves changing major business value streams that cut across 
organizational barriers. It provides the means by which the organization’s stra- 
tegic goals are to be achieved. This effort cannot be lead by anyone other than 
the CEO, who is responsible for the performance of the organization as a 
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whole. Six Sigma must be implemented from the top down. Lukewarm leader- 
ship endorsement is the number 1 cause of failed Six Sigma attempts. 
Conversely, I don’t know of a single case where top leadership fully embraced 
Six Sigma (or TQM, for that matter) that hasn’t succeeded. Six Sigma has zero 
chance of success when implemented without leadership from the top. This 
is because of the Six Sigma focus on cross-functional, even enterprise-wide 
processes. Six Sigma is not about local improvements, which are the only 
improvements possible when top-level support is lacking. 


CHAMPIONS AND SPONSORS 


Six Sigma champions are high-level individuals who understand Six Sigma 
and are committed to its success. In larger organizations Six Sigma will be 
lead by a full-time, high-level champion, such as an Executive Vice President. 
In all organizations, champions also include informal leaders who use Six 
Sigma in their day-to-day work and communicate the Six Sigma message at 
every opportunity. Sponsors are owners of processes and systems who help 
initiate and coordinate Six Sigma improvement activities in their areas of 
responsibilities. 


BLACK BELT 


Candidates for Black Belt status are technically oriented individuals held in 
high regard by their peers. They should be actively involved in the process of 
organizational change and development. Candidates may come from a wide 
range of disciplines and need not be formally trained statisticians or analysts. 
However, because they are expected to master a wide variety of technical tools 
ina relatively short period of time, Black Belt candidates will probably possess 
a background in college-level mathematics, the basic tool of quantitative analy- 
sis. Coursework in statistical methods should be considered a strong plus or 
even a prerequisite. As part of their training, Black Belts typically receive 160 
hours of classroom instruction, plus one-on-one project coaching from Master 
Black Belts or consultants. The precise amount of training varies considerably 
from firm to firm. In the financial sector Black Belts generally receive three 
weeks of training, while Black Belts in large research facilities may get as much 
as six weeks of training. 

Successful candidates will be comfortable with computers. At a minimum, 
they should be proficient with one or more operating systems, spreadsheets, 
database managers, presentation programs, and word processors. As part of 
their training they will also be required to become proficient in the use of one 
or more advanced statistical analysis software packages and probably simula- 
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tion software. Six Sigma Black Belts work to extract actionable knowledge from 
an organization’s information warehouse. To assure access to the needed infor- 
mation, Six Sigma activities should be closely integrated with the information 
systems of the organization. Obviously, the skills and training of Six Sigma 
Black Belts must be enabled by an investment in software and hardware. It 
makes no sense to hamstring these experts by saving a few dollars on computers 
or software. 


GREEN BELT 


Green Belts are Six Sigma project leaders capable of forming and facilitating 
Six Sigma teams and managing Six Sigma projects from concept to completion. 
Green Belt training consists of five days of classroom training and is conducted 
in conjunction with Six Sigma projects. Training covers project management, 
quality management tools, quality control tools, problem solving, and descrip- 
tive data analysis. Six Sigma champions should attend Green Belt training. 
Usually, Six Sigma Black Belts help Green Belts define their projects prior to 
the training, attend training with their Green Belts, and assist them with their 
projects after the training. 


MASTER BLACK BELT 


This is the highest level of technical and organizational proficiency. Master 
Black Belts provide technical leadership of the Six Sigma program. Thus, 
they must know everything the Black Belts knows, as well as additional skills 
vital to the success of the Six Sigma program. The additional skill might be 
deep understanding of the mathematical theory on which the statistical meth- 
ods are based. Or, perhaps, a gift for project management, coaching skills to 
help Black Belts, teaching skills, or program organization at the enterprise 
level. Master Black Belts must be able to assist Black Belts in applying the 
methods correctly in unusual situations, especially advanced statistical meth- 
ods. Whenever possible, statistical training should be conducted only by qua- 
lified Master Black Belts or equivalently skilled consultants. If it becomes 
necessary for Black Belts and Green Belts to provide training, they should 
only do so under the guidance of Master Black Belts. Otherwise the familiar 
“propagation of error” phenomenon will occur, ie., Black Belt trainers pass 
on errors to Black Belt trainees who pass them on to Green Belts, who pass 
on greater errors to team members. Because of the nature of the Master’s 
duties, all Master Black Belts must possess excellent communication and 
teaching skills. 
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STAFFING LEVELS AND EXPECTED RETURNS 


As stated earlier in this chapter, the number of full-time personnel devoted to 
Six Sigma is not large as a percentage of the total work force. Mature Six Sigma 
programs, such as those of General Electric, Johnson & Johnson, AlliedSignal, 
and others average about one percent of their workforce as Black Belts, with 
considerable variation in that number. There is usually about one Master 
Black Belt for every ten Black Belts, or about one Master Black Belt per 1,000 
employees. A Black Belt will typically complete 5 to 7 projects per year, usually 
working with teams. Project teams are often lead by Green Belts, who, unlike 
Black Belts and Master Black Belts, are not employed full time in the Six 
Sigma program. Green Belts usually devote between 5 and 10 percent of their 
time to Six Sigma project work. 

Black Belts are highly prized employees and are often recruited for key man- 
agement positions elsewhere in the company. After Six Sigma has been in place 
for three or more years, the number of former Black Belts in management posi- 
tions tends to be greater than the number of active Black Belts. These people 
take the rigorous, customer-driven, process-focused Six Sigma approach with 
them when they move to new jobs. The “Six Sigma way” soon becomes pervasive. 

Estimated savings per project vary from organization to organization. 
Reported results average about $150,000 to $243,000. Some industries just start- 
ing their Six Sigma programs average as high as $700,000 savings per project, 
although these projects usually take longer. Note that these are not the huge 
mega-projects pursued by reengineering. Still, by completing 5 to 7 projects 
per year per Black Belt the company will add in excess of $1 million per year 
per Black Belt to its bottom line. For a company with 1,000 employees the 
numbers would look something like this: 


Master Black Belts: 1 


Black Belts: 10 

Projects: 50 to 70 (5 to 7 per Black Belt) 

Estimated saving: $9 million to $14.6 million (ie., $14,580 savings 
per employee) 


Do the math for your organization and see what Six Sigma could do for you. 
Because Six Sigma savings—unlike traditional slash and burn cost cutting— 
impact only non-value-added costs, they flow directly to your company’s bot- 
tom line. Traditional, income-statement based cost cutting inevitably hurts 
value-adding activities. As a result, the savings seldom measure up to expecta- 
tions and revenues often suffer as well. The predicted bottom-line impact is 
not actually realized. Firms engaging in these activities hurt their prospects for 
future success and delay their recovery. 
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Six Sigma deployment and management 

Six Sigma deployment is the actual creation of an organization that embodies 
the Six Sigma philosophy. Doing this involves asking a series of questions, 
then answering these questions for organizational units. The deployment pro- 
cess is outlined in Figure 1.8. 

Creating an organization to carry out this process is no easy task. Traditional 
organizations are structured to carry out routine tasks, while Six Sigma is all 
about non-routine activity. Look at the action words in Figure 1.8: improve, 
increase, eliminate, reduce, breakthrough. These are challenging things to do in 
any environment, and nearly impossible in an enterprise focused on carrying 
out routine assignments. The job of the leadership team is to transform the orga- 
nization’s culture so that Six Sigma will flourish. It’s a tough job, but not an 
impossible one. Think of it as writing a book. No one sits down and writes a 
book as a single unit. Books are organized into smaller sub-units, such as sec- 
tions, chapters, pages, and paragraphs. Similarly, deploying Six Sigma involves 
sub-units, such as those shown in Figure 1.9. 

Although leadership is ultimately responsible for creating the Six Sigma 
Deployment Manual, they will not have the time to write it themselves. 
Writing the manual is itself a project, and it should be treated as such. A formal 
charter should be prepared and responsibility for writing the deployment man- 
ual should be assigned by senior leadership to a project sponsor. The sponsor 
should be a senior leader, either the CEO or a member of the CEO’s staff. An 
aggressive deadline should be set. The plan itself is the deliverable, and the 
requirements should be clearly defined. The CEO and the Executive Six Sigma 
Council must formally accept the plan. 

All of the subjects in the table of contents in Figure 1.9 are discussed in this 
book. Some are covered in several pages, while others take an entire chapter or 
more. Although you won’t be able to get all of your answers from a single 
book, or from any number of books, the material you will find here should 
give you enough information to start the journey. You will encounter enough 
challenges along the way that perhaps the word “adventure” would be more 
appropriate! 


Six Sigma communication plan 
Successful implementation of Six Sigma will only happen if the leadership’s 
vision and implementation plans are clearly understood and embraced by 
employees, shareholders, customers, and suppliers. Because it involves cultural 
change, Six Sigma frightens many people. Good communications are an anti- 
dote to fear. Without it rumors run rampant and morale suffers. Although 
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1. 


2. 


3. 


4. 


5. 


Deployment goals 


1.1. 


1.2. 


Business level 

1.1.1. Increase shareholder value 

1.1.2. Increase revenues 

1.1.3. Improve market share 

1.1.4. Increase profitability and ROI 

Operations level 

1.2.1. Eliminate “hidden factory” (i.e., resources used because things 
were not done right the first time) 

1.2.2. Improve rolled throughput yield and normalized yield 

1.2.3. Reduce labor costs 

1.2.4. Reduce material costs 

Process level 

1.3.1. Improve cycle time 

1.3.2. Reduce resource requirements 

1.3.3. Improve output volume 

1.3.4. Improve process yield (ratio of inputs to outputs) 

1.3.5. Reduce defects 

1.3.6. Reduce variability 

1.3.7. Improve process capability 


Identify key value streams 


2.1. 
2.2. 


Which processes are critical to business performance? 
How do processes deliver value to customers? 


Determine metrics and current performance levels 


3.1. 
3.2. 
3.3. 


3.4. 
3.5. 


How will we measure key value streams? 

Are our measurements valid, accurate, and reliable? 

Are the processes stable (i.e., in statistical control)? 

3.3.1. If not, why not? 

3.3.2. What are the typical cycle times, costs, and quality opportu- 
nities of these processes? 

3.3.3. What is the short- and long-term process capability? 

Detailed as-is and should-be process maps for critical processes 

How does current performance relate to benchmark or best-in-class 

performance? 


Breakthrough to new performance levels 


4.1. 
4.2. 
4.3. 
4.4. 


Which variables make the most difference? 

What are the best settings for these variables? 

Can the process be redesigned to become more robust? 

Can product be redesigned to become more robust and/or more easily 
produced? 


Standardize on new approach 


5.1. 
5.2. 
5.3. 
5.4. 


Write procedures describing how to operate the new process 

Train people in the new approach 

When necessary, use SPC to control process variation 

Modify inventory, cost accounting, and other business systems to 
assure that improved process performance is reflected in bids, order 
quantities, inventory trigger points, etc. 


Figure 1.8. Six Sigma deployment process outline. 
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Preface: The leadership vision for the organization 
I. | Six Sigma communication plan 

Il. Six Sigma organizational roles and responsibilities 

Ill. Six Sigma training 

IV. Six Sigma project selection, tracking, and management 
V. Six Sigma rewards and recognition 

VI. Six Sigma compensation and retention 

VII. Deploying Six Sigma to the supply chain 


Figure 1.9. Chapters in the Six Sigma Deployment Manual. 


change is the byword of Six Sigma, you should try to cause as little unnecessary 
disruption as possible. At the same time, the commitment of the enterprise to 
Six Sigma must be clearly and unambiguously understood throughout the orga- 
nization. This doesn’t happen by accident, it is the result of careful planning 
and execution. 

Responsibility for the communication process should be determined and 
assigned at the outset. The communication process owner will be held 
accountable by the Executive Six Sigma Council for the development and 
oversight of the communication plan. This may include impact on the process 
owner’s compensation and/or bonus, or other financial impact. Of course, 
the owner will need to put together a team to assist with the efforts. 
Development of the communication plan is a subproject, so the communica- 
tion process owner will report to the sponsor of the overall Six Sigma deploy- 
ment activity. 

The communication plan must identify the communication needs for each 
stakeholder group in the enterprise. Significant stakeholder groups include, 
but are not limited to, the following: 

¢ Key customers 

e Shareholders or other owners 

e Senior leadership 

e Middle management 

e Six Sigma change agents 

¢ The general employee population 

¢ Suppliers 


METRICS 


Metrics are, of course, a vital means of communication. Six Sigma metrics 
are discussed in detail elsewhere in this book. Suffice it to say here that Six 
Sigma metrics are based on the idea of a balanced scorecard. A balanced 
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scorecard is like the instrument panel in the cockpit of an airplane. It displays 
information that provides a complete view of the way the organization 
appears to its customers and shareholders, as well as a picture of key internal 
processes and the rate of improvement and innovation. Balanced scorecards 
also provide the means of assuring that Six Sigma projects are addressing 
key business issues. 


COMMUNICATIONS MEDIA 


Communicating the Six Sigma message is a multimedia undertaking. The 
modern organization has numerous communications technologies at its dis- 
posal. Keep in mind that communication is a two-way affair; be sure to pro- 
vide numerous opportunities for upward and lateral as well as downward 
communication. Here are some suggestions to accomplish the communica- 
tions mission: 

e All-hands launch event, with suitable pomp and circumstance 

e Mandatory staff meeting agenda item 

¢ House organs (newsletters, magazines, etc.) 

¢ Web site content on Six Sigma (Internet and Intranet) 

e Highly visible links to enterprise Six Sigma web site on home page 

e Six Sigma updates in annual report 

¢ Stock analyst updates on publicly announced Six Sigma goals 

e Intranet discussion forums 

¢ Two-way email communications 

e Surveys 

e Suggestion boxes 

e Videotape or DVD presentations 

¢ Closed circuit satellite broadcasts by executives, with questions and 

answers 

e All-hands discussion forums 

¢ Posters 

¢ Logo shirts, gear bags, keychains, coffee mugs, and other accessories 

¢ Speeches and presentations 

¢ Memoranda 

¢ Recognition events 

¢ Lobby displays 

¢ Letters 

The list goes on. Promoting Six Sigma awareness is, in fact, an internal mar- 
keting campaign. A marketing expert, perhaps from your company’s marketing 
organization, should be consulted. If your organization is small, a good book 
on marketing can provide guidance (e.g., Levinson et al. (1995)). 
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COMMUNICATION REQUIREMENTS AND 
RESPONSIBILITIES 


For each group, the communication process owner should determine the 

following: 

1. Who is primarily responsible for communication with this group? 

2. What are the communication needs for this group? For example, key 
customers may need to know how Six Sigma will benefit them; employ- 
ees may need to understand the process for applying for a change agent 
position such as Black Belt. 

3. What communication tools, techniques and methods will be used? These 
include meetings, newsletters, email, one-on-one communications, web 
sites, etc. 

4. What will be the frequency of communication? Remember, repetition 
will usually be necessary to be certain the message is received and under- 
stood. 

5. Who is accountable for meeting the communication requirement? 

6. How will we measure the degree of success? Who will do this? 

The requirements and responsibilities can be organized using tables, such as 

Table 1.3. 


Six Sigma organizational roles and responsibilities 

Six Sigma is the primary enterprise strategy for process improvement. To 
make this strategy a success it is necessary not only to implement Six Sigma, 
but also to institutionalize it as a way of doing business. It is not enough to 
train a few individuals to act as champions for Six Sigma. To the contrary, such 
a plan virtually guarantees failure by placing the Six Sigma activities somewhere 
other than the mainstream. After all, isn’t process improvement an ongoing 
part of the business? 


LEADERSHIP ROLES AND RESPONSIBILITIES 


Leadership’s primary role is to create a clear vision for Six Sigma success and 
to communicate their vision clearly, consistently, and repeatedly throughout 
the organization. In other words, leadership must lead the effort. 

The primary responsibility of leadership is to assure that Six Sigma goals, 
objectives, and progress are properly aligned with those of the enterprise as a 
whole. This is done by modifying the organization in such a way that personnel 
naturally pursue Six Sigma as part of their normal routine. This requires the 
creation of new positions and departments, and modifying the reward, recogni- 
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Table 1.3. Six Sigma communications plan and requirements matrix. 


Group Method Frequency Accountability 
Senior Leadership 
e Senior staff e At least e CEO 
Program strategy, meetings monthly e Six Sigma Director 
a goals and high- e Senior e Start of e Training 
5 | level program plan leadership program department 
: training 
c 
Pe, Metrics/status e Senior staff e At least e Six Sigma Director 
performance to meetings monthly 
program plan 
Middle Management 
e Regular flow e At least e Senior Leadership 
down of monthly for for staff meeting 
upper level staff flow down 
staff meeting meetings; 
notes/flow newsletter e Internal 
down; piece every 2 communications 
newsletter weeks during via core team for 
Program strategy, goals 
and management-level ee tas. 
e Management rollout, as newsletter 
progr ennplan training needed 
thereafter e Training 
department 


e Prior to 1st 
wave of Six 
Sigma 
projects 


Etc. for customers, owners, stock analysts, change agents, bargaining unit, exempt 


employees, suppliers, or other stakeholder group. 
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tion, incentive, and compensation systems for other positions. Leadership must 
decide such key issues as: 
¢ How will leadership organize to support Six Sigma? (E.g., Executive Six 
Sigma Council, designation of an executive Six Sigma champion, creation 
of Director of Six Sigma, where will the new Six Sigma function report? 
Etc.) 
e At what rate do we wish to make the transition from a traditional to a Six 
Sigma enterprise? 
¢ What will be our resource commitment to Six Sigma? 
¢ What new positions will be created? To whom will they report? 
e Will Six Sigma be a centralized or a decentralized function? 
¢ What level of ROI validation will we require? 
¢ How will Six Sigma be integrated with other process excellence initiatives, 
such as Lean? 
e Will we create a cross-functional core team to facilitate deployment? Who 
will be on the team? To whom will they be accountable? 
¢ How will leadership monitor the success of Six Sigma? 
¢ How will executive support of Six Sigma be assessed? 


TYPICAL ROLES AND RESPONSIBILITIES 


Although each organization will develop its own unique approach to Six 
Sigma, it is helpful to know how successful companies have achieved their 
success. Most importantly, successful Six Sigma deployment is always a top- 
down affair. I know of no case where Six Sigma has had a major impact on 
overall enterprise performance that was not fully embraced and actively 
lead by top management. Isolated efforts at division or department levels 
are doomed from the outset. Like flower gardens in a desert, they may flour- 
ish and produce a few beautiful results for a time, but sustaining the results 
requires immense effort by local heroes in constant conflict with the main- 
stream culture, placing themselves at risk. Sooner or later, the desert will 
reclaim the garden. Six Sigma shouldn’t require heroic effort—there are 
never enough heroes to go around. Once top management has accepted its 
leadership responsibility the organizational transformation process can 
begin. 

A key decision is whether Black Belts will report to a central Six Sigma 
organization or to managers located elsewhere in the organization. The 
experience of most successful Six Sigma enterprises is that centralized report- 
ing is best. Internal studies by one company that experimented with both 
types of reporting revealed the results shown in Table 1.4. The major reason 
for problems with the decentralized approach was disengaging people from 
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Table 1.4. Black Belt certification versus reporting arrangement. 


Black Belts Successfully 
Where Black Belt Reported Certified 
Local organization 40% 
Centralized Six Sigma 80% 
organization 


routine work and firefighting. Six Sigma is devoted to change, and it seems 
change tends to take a back seat to current problems. To be sure, the Black 
Belt possesses a skill set that can be very useful in putting out fires. Also, 
Black Belts tend to be people who excel at what they do. This combination 
makes it difficult to resist the urge to pull the Black Belt off of his or her pro- 
jects “just for a while.” In fact, some organizations have trouble getting the 
Black Belt out of their current department and into the central organization. 
In one case the CEO intervened personally on behalf of the Black Belts to 
break them loose. Such stories are testimony to the difficulties encountered 
in making drastic cultural changes. 

The transformation process involves new roles and responsibilities on the 
part of many individuals in the organization. In addition, new change agent 
positions must be created. Table 1.5 lists some typical roles and responsi- 
bilities. 

Obviously, the impact on budgets, routines, existing systems, etc. is sub- 
stantial. Six Sigma is not for the faint-hearted. It isn’t hard to see why it takes a 
number of years for Six Sigma to become “mature.” The payoff, however, 
makes the effort worthwhile. Half-hearted commitments take nearly as much 
effort and produce negligible results, or even negative impacts. 


Selecting the “Belts” 


Past improvement initiatives, such as TQM, shared much in common with 
Six Sigma. TQM also had management champions, improvement projects, 
sponsors, etc. One of the main differences in the Six Sigma infrastructure is 
the creation of more formally defined change agent positions. Some observers 
criticize this practice as creating corps of “elites,” especially Black Belts and 
Master Black Belts. However, I believe this criticism is invalid. Let’s examine 
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Table 1.5. Six Sigma roles and responsibilities. 


Responsible 
Entity 


Roles 


Responsibilities 


Executive 
Six Sigma 
Council 


Director, 
Six Sigma 


Strategic leadership 


¢ Ensures Six Sigma goals are linked to 
enterprise goals 

* Develops new policies as required 

¢ Aligns process excellence efforts across 
the organization 

¢ Suggests high-impact projects 

¢ Approves project selection strategy 


Assures progress 


* Provides resources 

¢ Tracks and controls progress toward 
goals 

¢ Reviews improvement teams’ results 
(BB, GB, Lean, Supply Chain, other) 

Reviews effectiveness of Six Sigma 
deployment: systems, processes, 
infrastructure, etc. 


Cultural transformation 


Manages Six Sigma 
infrastructure and 
resources 


© Communicates vision 

© Removes formal and informal barriers 

¢ Commissions modification of 
compensation, incentive, reward and 
recognition systems 


¢ Six Sigma champion for ACME 

¢ Develops Enterprise Six Sigma 
deployment 

¢ Owns the Six Sigma project selection 
and prioritization process for ACME 

e Assures Six Sigma strategies and 
projects are linked through quality 
function deployment to business plans 

¢ Achieves defect reduction and cost take- 
out targets through Six Sigma activities 

¢ Member of Executive Six Sigma Council 

¢ Leads and evaluates the performance of 
Black Belts and Master Black Belts 

¢ Communicates Six Sigma progress with 
customers, suppliers and the enterprise 
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Table 1.5. Six Sigma roles and responsibilities (continued) 


Responsible 
Entity Roles Responsibilities 
¢ Champions Six Sigma reward and 
recognition, as appropriate 
Six Sigma Certifies Black Belts ¢ Works with local units to customize 
Certification Black Belt and Green Belt requirements 
Board Board representatives to fit business needs 
include Master Black ¢ Develops and implements systems for 
Belts and key Six Sigma certifying Black Belts and Green Belts 
leaders * Certifies Black Belts 
Six Sigma Cross-functional Six ¢ Provides input into policies and 
Core Team Sigma team procedures for successful 
implementation of Six Sigma across 
Part-time change agent ACME 
¢ Facilitates Six Sigma activities such as 
training, special recognition events, 
Black Belt testing, etc. 
Master Black Enterprise Six Sigma ¢ Highly proficient in using Six Sigma 
Belt expert methodology to achieve tangible 
business results 
Permanent full-time ¢ Technical expert beyond Black Belt level 
change agent on one or more aspects of process 
improvement (e.g., advanced statistical 
Certified Black Belt with analysis, project management, 
additional specialized communications, program 
skills or experience administration, teaching, project 
especially useful in coaching) 
deployment of Six Sigma e Identifies high-leverage opportunities for 
across the enterprise applying the Six Sigma approach across 


the enterprise 

¢ Basic Black Belt training 

* Green Belt training 

© Coach/Mentor Black Belts 

¢ Participates on ACME Six Sigma 
Certification Board to certify Black Belts 
and Green Belts 
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Table 1.5. Six Sigma roles and responsibilities (continued) 


Responsible 
Entity 


Roles 


Responsibilities 


Black Belt Six Sigma technical expert | ® Leads business process improvement 
projects where Six Sigma approach is 
Temporary, full-time indicated 
change agent (will return ¢ Successfully completes high-impact 
to other duties after projects that result in tangible benefits 
completing a two to three to the enterprise 
year tour of duty asa ¢ Demonstrated mastery of Black Belt 
Black Belt) body of knowledge 
¢ Demonstrated proficiency at achieving 
results through the application of the Six 
Sigma approach 
¢ Internal Process Improvement 
Consultant for functional areas 
© Coach/Mentor Green Belts 
¢ Recommends Green Belts for 
Certification 
Green Belt Six Sigma project ¢ Demonstrated mastery of Green Belt 
originator body of knowledge 
¢ Demonstrated proficiency at achieving 
Six Sigma project leader results through the application of the Six 
Sigma approach 
Part-time Six Sigma ¢ Recommends Six Sigma projects 
change agent. Continues Participates on Six Sigma project teams 
to perform normal duties | ® Leads Six Sigma teams in local 
while participating on Six improvement projects 
Sigma project teams ¢ Works closely with other continuous 
improvement leaders to apply formal 
Six Sigma champion in data analysis approaches to projects 
local area ¢ Teaches local teams, shares knowledge 
of Six Sigma 
¢ Successful completion of at least one Six 
Sigma project every 12 months to 
maintain their Green Belt certification 
Six Sigma Primary ACME vehicle * Completes chartered Six Sigma projects 
Improvement | for achieving Six Sigma that deliver tangible results 
Team improvements e Identifies Six Sigma project candidates 
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Table 1.5. Six Sigma roles and responsibilities (continued) 


Responsible 

Entity Responsibilities 

ACME Champions for Six Sigma_ | ¢ Ensures flow-down and follow-through 
Leaders and on goals and strategies within their 
Managers organizations 


¢ Plans improvement projects 

¢ Charters or champions chartering 
process 

¢ Identifies teams or individuals required 
to facilitate Six Sigma deployment 

Integrates Six Sigma with performance 
appraisal process by identifying 
measurable Six Sigma goals/objectives/ 
results 

° Identifies, sponsors and directs Six 
Sigma projects 

¢ Holds regular project reviews in 
accordance with project charters 

¢ Includes Six Sigma requirements in 
expense and capital budgets 

Identifies and removes organizational 
and cultural barriers to Six Sigma 
success 

© Rewards and recognizes team and 
individual accomplishments (formally 
and informally) 

¢ Communicates leadership vision 

* Monitors and reports Six Sigma progress 

© Validates Six Sigma project results 

© Nominates highly qualified Black Belt 
and/or Green Belt candidates 


Project Charter and support Six ¢ Sponsor is ultimately responsible for the 

Sponsor Sigma project teams success of sponsored projects 

* Actively participates in projects 

¢ Assures adequate resources are provided 
for project 
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Table 1.5. Six Sigma roles and responsibilities (continued) 


Responsible 
Entity Roles Responsibilities 
Personal review of progress 
¢ Identifies and overcomes barriers and 
issues 
¢ Evaluates and accepts deliverable 
“Matrixed” Manages Six Sigma ¢ Provides day-to-day direction for Six 
Project resources dedicated toa Sigma project Black Belt and team 
Manager particular area (e.g., teams activities 
of Black Belts on special ¢ Provides local administrative support, 
assignment) facilities, and materials 
* Conducts periodic reviews of projects 
Champions Six Sigma ¢ Provides input on Black Belt 
Black Belt team performance appraisals 
* Makes/implements decisions based on 
recommendations of Six Sigma Black 
Belts 
Six Sigma Learns and applies Six * Actively participates in team tasks 
Improvement | Sigma tools to projects ¢ Communicates well with other team 
Team Member members 


¢ Demonstrates basic improvement tool 
knowledge 


* Accepts and executes assignments as 


determined by team 


the commonly proposed alternatives to creating a relatively small group of 
highly trained technical experts: 
¢ Train the masses. This is the “quality circles” approach, where people in 
the lowest level of the organizational hierarchy are trained in the use of 
basic tools and set loose to solve problems without explicit direction 
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from leadership. When this approach was actually tried in America in the 
1970s the results were disappointing. The originators of the quality circles 
idea, the Japanese, reported considerably greater success with the 
approach. This was no doubt due to the fact that Japanese circles were 
integrated into decades old company-wide process improvement activ- 
ities, while American firms typically implemented circles by themselves. 
Indeed, when Six Sigma deployments reach a high level of maturity, 
more extensive training is often successful. 

Train the managers. This involves training senior and middle management 
in change agent skills. This isn’t a bad idea of itself. However, if the basic 
structure of the organization doesn’t change, there is no clear way to 
apply the newly acquired skills. Training in and of itself does nothing to 
change an organization’s environment. Historically, trained managers 
return to pretty much the same job. As time goes by their skills atrophy 
and their self-confidence wanes. If opportunities to apply their knowledge 
do arise, they often fail to recognize it or, if they do recognize it, fail to cor- 
rectly apply the approach. This is natural for a person trying to do some- 
thing different for the first time. The full-time change agents in Six Sigma 
learn by doing. By the end of their tenure, they can confidently apply Six 
Sigma methodology to a wide variety of situations. 

Use the experts in other areas. The tools of Six Sigma are not new. In fact, 
Industrial Statisticians, ASQ Certified Quality Engineers, Certified 
Reliability Engineers, Certified Quality Technicians, Systems Engineers, 
Industrial Engineers, Manufacturing Engineers and other specialists 
already possess a respectable level of expertise in many Six Sigma tools. 
Some have a level of mastery in some areas that exceeds that of Black 
Belts. However, being a successful change agent involves a great deal 
more than mastery of technical tools. Black Belts, Green Belts, and 
Master Black Belts learn tools and techniques in the context of following 
the DMAIC approach to drive organizational change. This is very differ- 
ent than using the same techniques in routine daily work. Quality ana- 
lysts, for example, generally work in the quality department as 
permanent, full-time employees. They report to a single boss and have 
well-defined areas of responsibility. Black Belts, in contrast, go out and 
seek projects rather than work on anything routine. They report to many 
different people, who use different criteria to evaluate the Black Belt’s per- 
formance. They are accountable for delivering measurable, bottom-line 
results. Obviously, the type of person who is good at one job may not be 
suitable for the other. 

Create permanent change agent positions. Another option to the Black Belt 
position is to make the job permanent. After all, why not make maximum 
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use of the training by keeping the person in the Black Belt job indefinitely? 
Furthermore, as Black Belts gain experience they become more proficient 
at completing projects. There are, however, arguments against this 
approach. Having temporary Black Belts allows more people to go through 
the position, thus increasing the number of people in management with 
Black Belt experience. Since Black Belts work on projects that impact 
many different areas of the enterprise, they have a broad, process-oriented 
perspective that is extremely valuable in top management positions. The 
continuous influx of new blood into Black Belt and Green Belt positions 
keeps the thinking fresh and prevents the “them-versus-us” mentality that 
often develops within functional units. New Black Belts have different net- 
works of contacts throughout the organization, which leads to projects in 
areas that might otherwise be missed. Permanent Black Belts would almost 
certainly be more heavily influenced by their full-time boss than temporary 
Black Belts, thus leading to a more provincial focus. 


BLACK BELTS 


There are usually many more Black Belt candidates than there are positions. 
Thus, although there are minimum requirements, those selected generally 
exceed the minimums by a considerable degree. The process for selecting Black 
Belts should be clearly defined. This assures consistency and minimizes the 
possibility of bias and favoritism. 

The next question is, what’s important to the success of a Black Belt? I 
worked with a group of consultants and Master Black Belts to answer this ques- 
tion. We came up with a list of seven success factors, then used Expert Choice 
2000 software* to calculate relative importance weights for each category. The 
results are shown in Figure 1.10. 

The weights are, of course, subjective and only approximate. You may feel 
free to modify them if you feel strongly that they’re incorrect. Better yet, you 
may want to identify your own set of criteria and weights. The important thing 
is to determine the criteria and then develop a method of evaluating candidates 
on each criterion. The sum of the candidate’s criterion score times the criterion 
weight will give you an overall numerical assessment that can be useful in sort- 
ing out those candidates with high potential from those less likely to succeed 
as Black Belts. Of course, the numerical assessment is not the only input into 
the selection decision, but it is a very useful one. 


*Expert Choice 2000 is a software package that converts pairwise comparisons into relative weights using the Analytic 
Hierarchy Process. The AHP is described elsewhere in this book. See http://www.expertchoice.com/ for details. 
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Figure 1.10. Black Belt success factors and importance weights. 


You may be surprised to see the low weight given to math skills. The ratio- 
nale is that Black Belts will receive 200 hours of training, much of it focused 
on the practical application of statistical techniques using computer software 
and requiring very little actual mathematics. Software automates the analysis, 
making math skills less necessary. The mathematical theory underlying a tech- 
nique is not discussed beyond the level necessary to help the Black Belt prop- 
erly apply the tool. Black Belts who need help with a particular tool have 
access to Master Black Belts, other Black Belts, consultants, professors, and 
a wealth of other resources. Most statistical techniques used in Six Sigma are 
relatively straightforward and often graphical; spotting obvious errors is 
usually not too difficult for trained Black Belts. Projects seldom fail due to a 
lack of mathematical expertise. In contrast, the Black Belt will often have to 
rely on their own abilities to deal with the obstacles to change they will inevi- 
tably encounter. Failure to overcome the obstacle will often spell failure of 
the entire project. 

Figure 1.11 provides an overview of a process for the selection of Black Belt 
candidates. 
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Minimum Criteria 

Education—Bachelors Degree, minimum. 

Work Experience—At least 3 years of business, technical, or managerial experience 
plus technical application of education and experience as a member or leader of 
functional and cross-functional project teams. 

Technical Capability—Project management experience is highly desired. 
Understanding of basic principles of process management. Basic college algebra 
proficiency as demonstrated by exam. 

Computer Proficiency—MS Office Software Suite. 

Communication—Demonstrate excellent oral and written communication skills. 
Team Skills—Ability to conduct meetings, facilitate small groups and successfully 
resolve conflicts. Ability to mentor and motivate people. 


Final Candidate Selection 

To ensure that the Black Belts will be able to address enterprise-wide issues and 
processes, the Director of Six Sigma and the Executive Six Sigma Council will deter- 
mine the number of Black Belts to be trained in each functional area, division, depart- 
ment, etc. Black Belt candidates are ranked using a system of points assigned during 
the screening process. Rank-ordered lists of Black Belt candidates are prepared for 
designated areas and presented to the senior management of the area for final selec- 
tion. Area management nominates candidates from their list in numbers sufficient to fill 
the spaces allocated by the Director of Six Sigma and the Executive Six Sigma 
Council. 


Commitment to Black Belt Assignment 

Selected candidates are required to attend 200 hours of Black Belt training (see 
Chapter 4 for the training content). Within one year of completing training, the 
Black Belt candidate is required to become certified by passing a written examination 
and successfully completing at least two major projects. (See the Appendix for 
detailed Black Belt certification process information.) The Black Belt is assigned to 
Six Sigma full time as a Black Belt for a minimum period of 2 full years, measured 
from the time he or she is certified as a Black Belt. 


Reintegration of Black Belts into the Organization 

Black Belts are employed in the Black Belt role for two or three years. After that time 
they leave the Six Sigma organization and return to other duties. Accomplishing this 
transition is the joint responsibility of the Black Belt, the Director of Six Sigma, and the 
management of the Black Belt’s former department. Collectively this group comprises 
the “Transition Team” for the Black Belt. However, senior leadership must accept 
ultimate responsibility for assuring that Black Belts are not “homeless” after complet- 
ing their Black Belt tour of duty. 

The Director of Six Sigma will inform the Black Belt at least six months prior to the 
scheduled return. The Black Belt should maintain contact with their “home” organiza- 
tion during his tenure in Six Sigma. If it appears that there will be a suitable position 
available at approximately the time the Black Belt is scheduled to return, arrange- 
ments should be made to complete or hand-off the Black Belt’s Six Sigma projects in 
preparation for his return. If no suitable openings will be available, the Transition 
Team needs to develop alternative plans. Alternatives might include extending the 
Black Belt’s term of service in Six Sigma, looking for openings in other areas, or 
making temporary arrangements. 


Figure 1.11. Black Belt candidate selection process and criteria. 
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GREEN BELTS 


Green Belts are change agents who work part time on process improve- 
ment. The bulk of the Green Belt’s time is spent performing their normal 
work duties. Although most experts (including me) advocate that the Green 
Belt spend 10% to 20% of their time on projects, the time a typical Green 
Belt spends on projects in a given year is more like 2% to 5%. A Green Belt 
will usually complete one or two major projects per year. Also, unlike Black 
Belt projects, Green Belt projects may address processes that are not cross- 
functional. Few Green Belt projects cover enterprise-wide processes. 
However, since there are usually more Green Belts than Black Belts by a fac- 
tor of 2x to 5x, these Green Belt projects have a tremendous impact on 
the enterprise. Also, it is common to have a Black Belt coordinating a “port- 
folio” of “Green Belt projects’”* that, taken together, cover a cross-functional 
process. 

Figure 1.12 provides an overview of a process for the selection of Green Belt 
candidates. 


MASTER BLACK BELTS 


Master Black Belts are recruited from the ranks of Black Belts. The process 
is usually less formal and less well defined than that for Black Belts or 
Green Belts and there is a great deal of variability between companies. 
Master Black Belt candidates usually make their interest known to Six 
Sigma leadership. Leadership selects candidates based on the needs of the 
enterprise and Six Sigma’s role in meeting those needs. For example, in the 
early stages of deployment Master Black Belt candidates with excellent orga- 
nizational skills and the ability to communicate the leadership’s Six Sigma 
vision may be preferred. Intermediate deployments might favor candidates 
who excel at project selection and Black Belt coaching. Mature Six Sigma pro- 
grams might look for Master Black Belts with training ability and advanced 
statistical know-how. Master Black Belts often have advanced technical 
degrees and extensive Black Belt experience. Many organizations provide 
Master Black Belts with additional training. Certification requirements for 
Master Black Belts varies with the organization. Many organizations do not 
certify Master Black Belts. 


*Personally, I would prefer that the term “Six Sigma project” be used instead of Black Belt project or Green Belt project. 


However, I bow to common usage in this book. 
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Minimum Criteria 

Education—High school or equivalent. 

Work Experience—At least 3 years of business, technical, or managerial experience. 
Technical Capability—High school algebra proficiency as demonstrated by a passing 
grade in an algebra course. 

Computer Proficiency—Word processing, presentation and spreadsheet software. 
Team Skills—Willingness to lead meetings, facilitate small groups and successfully 
resolve conflicts. Ability to mentor and motivate people. 


Final Candidate Selection 

Based on the organizational need for Green Belts, as determined by the Director of 
Six Sigma and the Executive Six Sigma Council, Green Belt training allotments are 
provided to Master Black Belts, Black Belts and/or General Managers. Green Belt 
candidacy requires the consent of the candidate’s management. 


Commitment 

Each Green Belt candidate selected will be required to complete a 40 hour Green Belt 
training course, and to lead at least one successful Six Sigma project every 12 
months, or participate on at least two successful Six Sigma projects every 12 months. 
Green Belt certification is accomplished as described in the Appendix. 


Figure 1.12. Green Belt candidate selection process and criteria. 


Integrating Six Sigma and related initiatives 


At any given time most companies have numerous activities underway to 
improve their operations. For example, the company might be pursuing one or 
more of the following: 

© TQM 

e Lean manufacturing 

e Lean service 

¢ Continuous improvement 

¢ Kaizen 

e Business process reengineering 

¢ Theory of constraints 

e Variation reduction 

The list can be extended indefinitely. Six Sigma can’t simply be thrown into 
the mix without causing tremendous confusion. People will find themselves in 
conflict with one another over jurisdiction, resources, and authority. 
Leadership must give careful thought as to how the various overlapping activ- 
ities can best be organized to optimize their impact on performance. An 
“umbrella concept” often provides the needed guidance to successfully inte- 
grate the different but related efforts. One concept that I’ve found to be particu- 
larly useful is that of “Process Excellence” (PE). 
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WHAT IS PROCESS EXCELLENCE? 


Organizations are typically designed along functional lines. Functions, 
such as engineering, marketing, accounting, manufacturing, and so on are 
assigned responsibility for certain tasks. The functions tend to correspond clo- 
sely to university degree programs. Persons with higher education in a func- 
tional area specialize in the work assigned to the function. General 
management and finance allocate resources to each function based on the 
needs of the enterprise. 

If the enterprise is to be successful the “needs of the enterprise” must be 
based on the needs of its customers. However, customers typically obtain 
value not from organizational functions but from products or services that are 
created by the cooperative efforts and resources of many different functional 
areas. Most customers couldn’t care less about how the enterprise creates the 
values they are purchasing.* A similar discussion applies to owners and share- 
holders. In fact, there is a substantial body of opinion among management 
experts that focusing internally on functional concerns can be detrimental to 
the enterprise as a whole. An alternative is to focus on the process or value 
stream that creates and delivers value. 

A process focus means that stakeholder values are determined and activ- 
ities are classified as either relating to the creation of the final value (value- 
added activity) or not (non-value-added activity). Processes are evaluated on 
how effectively and efficiently they create value. Effectiveness is defined as 
delivering what the customer requires, or exceeding the requirements; it 
encompasses quality, price, delivery, timeliness and everything else that goes 
into perceived value. Efficiency is defined as being effective using a minimum 
of resources; more of an owner’s perspective. Excellent processes are those 
that are both effective and efficient. 

PE is the set of activities specifically designed to create excellent processes. 
PE is change-oriented and cross-functional. It includes Six Sigma, all of the 
initiatives listed earlier, and many more as well. By creating a top-level posi- 
tion for PE, leadership assigns clear responsibility for this important work. 
The PE leader, usually a Vice President, leads a Process Excellence 
Leadership Team (PELT) which includes functional leaders as well as full- 
time PE personnel such as the Director of Six Sigma. The VP of PE isn’t 
responsible for particular processes, but she has the authority to identify key 
processes and nominate owners for approval by the CEO or the PELT. 
Examples of processes include: 


*There are exceptions to this. Many large customers, such as the Department of Defense or automobile or aircraft manufac- 
turers, take a very active interest in the internal operations of their key suppliers. 
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¢ Order fulfillment 

¢ Coordinating improvement activities of Six Sigma, Lean, etc. 

¢ Customer contact with the company 

¢ Handling public relations emergencies 

¢ Getting ideas for improvement projects 

¢ Matching improvement projects with customer needs 

e Innovating 

¢ Communicating with the outside world 

¢ Communicating internally 

e Identifying talent 

¢ Handling customer problems 

e Avoiding legal disputes 

In other words, the VP of PE has a “meta-process”’ responsibility. She is 
responsible for the process of identifying and improving processes. PE activities 
such as Six Sigma, Lean, etc. provide PE with resources to direct toward the 
organization’s goal of developing internal processes that give it a competitive 
advantage in securing the best employees, delivering superior customer value, 
and earning a premium return for its investors. 


Deployment to the supply chain 

In the early part of the twentieth century Henry Ford pursued a great vision 
by building the Ford River Rouge Complex. By 1927 the Rouge was handling 
all production of Ford automobiles. It was truly a marvel. The Rouge was the 
largest single manufacturing complex in the United States, with peak employ- 
ment of about 120,000. Here Henry Ford achieved self-sufficiency and vertical 
integration in automobile production, a continuous work flow from iron ore 
and other raw materials to finished automobiles. The complex included dock 
facilities, blast furnaces, open-hearth steel mills, foundries, a rolling mill, metal 
stamping facilities, an engine plant, a glass manufacturing building, a tire 
plant, and its own power house supplying steam and electricity. 

On June 2, 1978, the Rouge was listed a National Historic Landmark. From 
state-of-the-art wonder to historical curiosity in just fifty years. 

A related historical artifact is the idea that a firm can produce quality pro- 
ducts or services by themselves. This may’ve been the case in the heyday of the 
Rouge, when the entire “supply chain” was a single, vertically integrated behe- 
moth entity, but it is certainly no longer true. In today’s world fully 50-80% of 
the cost of a manufactured product is in purchased parts and materials. When 
the customer forks over her good money for your product, she doesn’t differ- 
entiate between you and your suppliers. 
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You say you're not in manufacturing? The situation is the same for you. Say, 
for example, your product is personal finance software. Your customer runs 
your software on a computer you didn’t design with an operating system you 
have no control over. They’re using your software to access their account at 
their financial institution to complete a tax return, which they’ll file electroni- 
cally with the IRS. When your customers click the icon to run your product, 
they consider all of these intermediaries to be part of the value they are paying 
to receive. 

The service industry is no different. Let’s say you are a discount brokerage 
company. Your customers want to be able to use your service to buy common 
stocks, fixed income instruments, derivatives, etc. They also want debit cards, 
check writing, bill paying, pension plans, and a variety of other services. Oh, 
and don’t forget financial advice, investment portfolio analysis, and annuities. 
When your customers put their money into their account at your firm, they 
expect you to be responsible for making all of the “third parties” work together 
seamlessly. 

In short, you'll never reach Six Sigma quality levels with three sigma suppliers. 


SUPPLY CHAIN MANAGEMENT SIX SIGMA ROLES 
AND RESPONSIBILITIES 


Your primary mission in the supplier Six Sigma activity is to obtain Six Sigma 
supplier quality with minimal costs. In pursuit of this mission you will initiate 
a number of Six Sigma projects that involve suppliers. The organization respon- 
sible for supply chain management (SCM) will take the lead in developing the 
supplier Six Sigma program. Leadership includes preparing the Supplier Six 
ee Deployment Plan. The plan should include the following: 

Policies on supplier Six Sigma 

¢ Goals and deliverables of the supplier Six Sigma program 

¢ Supplier communication plan 

¢ Timetable for deployment, including phases (e.g., accelerated deployment 

to most critical suppliers) 

¢ Procedures defining supplier contact protocols, supplier project charter, 

supplier project reporting and tracking, etc. 

e Training requirements and timeline 

¢ Methods of assessing supplier Six Sigma effectiveness 

e Integration of the supplier Six Sigma program and in-house activities 

SCM receives guidance from the Executive Six Sigma Council and the Six 
Sigma organization. The Six Sigma organization often provides expertise and 
other resources to the supplier Six Sigma effort. 
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SCM should sponsor or co-sponsor supplier Six Sigma projects. In some 
cases SCM will lead the projects, often with supplier personnel taking a co- 
leadership role. In others they will assist Black Belts or Green Belts working 
on other projects that involve suppliers. Full SCM sponsorship is usually 
required when the project’s primary focus is on the supplier’s product or pro- 
cess. For example, a Six Sigma project chartered to reduce the number of 
late deliveries of a key product. Projects involving suppliers, but not focused 
on them, can be co-sponsored by SCM. For example, a project involving the 
redesign of an order fulfillment process that requires minor changes to the 
supplier’s web ordering form. SCM assistance can take a number of different 
forms, e.g.: 

e Acting asa liaison between the internal team members and suppliers 

¢ Negotiating funding and budget authority for supplier Six Sigma projects 

e Estimating and reporting supplier project savings 

¢ Renegotiating contract terms 

¢ Resolving conflicts 

e Defining responsibility for action items 

¢ Scheduling supplier visits 

¢ Defining procedures for handling of proprietary supplier information 

¢ Responding to supplier requests for assistance with Six Sigma 

In addition to SCM, other elements within your organization play important 
supporting roles. Usually Black Belts will come from the Six Sigma organiza- 
tion, although some larger enterprises assign a team of Black Belts to work on 
SCM projects full time. Green Belts often come from organizations sponsoring 
supplier-related projects. Team members are assigned from various areas, as 
with any Six Sigma project. 


SUPPLIER RESPONSIBILITIES 


Never forget that the supplier’s processes are owned and controlled by the 
supplier, not by you. As the customer you certainly have the final say in the 
requirements, but ultimate responsibility for the process itself should remain 
with the supplier. To do otherwise may have legal ramifications, such as liability 
and warranty implications. Besides these issues is the simple human tendency 
of caring less when someone else is responsible. Six Sigma teams also need to 
be careful about making it clear that only SCM has the authority to make official 
requests for change. It can be embarrassing if a Black Belt makes a suggestion 
that the supplier believes to be a formal requirement to change. SCM may 
receive a new bid, price change, complaint letter, etc. from the supplier over 
such misunderstandings. Supplier relationships are often quite fragile and 
“Handle with care” is a good motto for the entire Six Sigma team to follow. 
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In addition to accepting responsibility for their processes, suppliers must 
often take the lead role in Six Sigma teams operating in supplier facilities. 
Supplier leadership must support Six Sigma efforts within their organizations. 
Suppliers must agree to commit the resources necessary to successfully com- 
plete projects, including personnel and funding. 


CHANGE AGENT COMPENSATION AND RETENTION 


Experienced Certified Black Belts and Master Black Belts are in great 
demand throughout the manufacturing and services sectors.* Small wonder. 
Here are people who have proven that they can effect meaningful change in a 
complex environment. Since organizations exist in a competitive world, steps 
must be taken to protect the investment in these skilled change agents, or they 
will be lured away by other organizations, perhaps even competitors. The most 
common (and effective) actions involve compensation and other financial 
incentives, such as: 

¢ Bonuses 

¢ Stock options 

¢ Results sharing 

e Payment of dues to professional societies 

e Pay increases 

There are also numerous non-financial and quasi-financial rewards. For 
example, Black Belts reentering the workforce after their tour of duty often 
enter positions that pay significantly higher than the ones they left when becom- 
ing Black Belts. In fact, in some companies the Black Belt position is viewed as 
a step on the fast track to upper management positions. Also, change is “news” 
and it is only natural that the names of Master Black Belts and Black Belts 
involved in major change initiatives receive considerable publicity on company 
web sites as well as in newsletters, recognition events, project fairs, etc. Even if 
they don’t receive formal recognition, Six Sigma projects often generate a great 
deal of internal excitement and discussion. The successful Black Belt usually 
finds that his work has earned him a reputation that makes him a hot commod- 
ity when it’s time to end his Black Belt career. 

There are, of course, innumerable complexities and details to be decided and 
worked out. Usually these issues are worked out by a team of individuals with 
members from Human Resources, the Six Sigma Core Team, and other areas 
of the organization. The team will address such issues as: 


* Although Green Belts are also highly trained change agents, they are not full-time change agents and we will not discuss their 


compensation here. 
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What pay grade is to be assigned to the Black Belt and Master Black Belt 
positions? 

Should the pay grade be determined by the pay grade of the candidate’s job 
prior to becoming a Black Belt? 

Should the Black Belt pay grade be guaranteed when the Black Belt leaves 
the Black Belt position to return to the organization? 

How do we determine eligibility for the various rewards? For example, are 
there key events such as acceptance as a Black Belt candidate, completion 
of training, completion of first project, successful certification, etc.? 
What about Black Belts who were certified by other organizations or third 
parties? 

Do we provide benefits to Green Belts as well? If so, what and how? 

Who will administer the benefits package? 


The plan will be of great interest to Black Belt candidates. If not done prop- 
erly, the organization will find it difficult to recruit the best people. 
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CHAPTER 


Six Sigma Goals and Metrics 


ATTRIBUTES OF GOOD METRICS 


The choice of what to measure is crucial to the success of the organization. 
Improperly chosen metrics lead to suboptimal behavior and can lead people 
away from the organization’s goals instead of towards them. Joiner (1994) sug- 
gests three systemwide measures of performance: overall customer satisfaction, 
total cycle time, and first-pass quality. An effective metric for quantifying first- 
pass quality is total cost of poor quality (later in this chapter). Once chosen, 
the metrics must be communicated to the members of the organization. To 
be useful, the employee must be able to influence the metric through his 
performance, and it must be clear precisely how the employee’s performance 
influences the metric. 

Rose (1995) lists the following attributes of good metrics: 


They are customer centered and focused on indicators that provide value 
to customers, such as product quality, service dependability, and time- 
liness of delivery, or are associated with internal work processes that 
address system cost reduction, waste reduction, coordination and team 
work, innovation, and customer satisfaction. 

They measure performance across time, which shows trends rather than 
snapshots. 

They provide direct information at the level at which they are applied. 
No further processing or analysis is required to determine meaning. 
They are linked with the organization’s mission, strategies, and actions. 
They contribute to organizational direction and control. 

They are collaboratively developed by teams of people who provide, 
collect, process, and use the data. 


Copyright 2003 by The McGraw-Hill Companies, Inc. Click Here for Terms of Use. 
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Rose also presents a performance measurement model consisting of eight 


steps: 
e 


Step 1: performance category—This category is the fundamental divi- 
sion of organizational performance that answers the question: What do 
we do? Sources for determining performance categories include an organi- 
zation’s strategic vision, core competencies, or mission statement. An 
organization will probably identify several performance categories. 
These categories define the organization at the level at which it is being 
measured. 

Step 2: performance goal—The goal statement is an operational defini- 
tion of the desired state of the performance category. It provides the target 
for the performance category and, therefore, should be expressed in expli- 
cit, action-oriented terms. An initial goal statement might be right on the 
mark, so complex that it needs further division of the performance cate- 
gory, or so narrowly drawn that it needs some combination of perfor- 
mance categories. It might be necessary to go back and forth between the 
performance goals in this step and the performance categories in step 1 
before a satisfactory result is found for both. 

Step 3: performance indicator—This is the most important step in the 
model because this is where progress toward the performance goal is dis- 
closed. Here irrelevant measures are swept aside if they do not respond 
to an organizational goal. This is where the critical measures—those that 
communicate what is important and set the course toward organizational 
success—are established. Each goal will have one or more indicators, and 
each indicator must include an operational definition that prescribes the 
indicator’s intent and makes its role in achieving the performance goal 
clear. The scope of the indicator might be viewed differently at various 
levels in the organization. 

Step 4: elements of measure—These elements are the basic components 
that determine how well the organization meets the performance 
indicator. They are the measurement data sources—what is actually 
measured—and are controlled by the organization. Attempting to mea- 
sure things that are beyond organizational control is a futile diversion of 
resources and energy because the organization is not in a position to 
respond to the information collected. This would be best handled in the 
next step. 

Step 5: parameters—These are the external considerations that influence 
the elements of measure in some way, such as context, constraint, and 
boundary. They are not controlled by the organization but are powerful 
factors in determining how the elements of measure will be used. If 
measurement data analysis indicates that these external considerations 
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present serious roadblocks for organizational progress, a policy change 
action could be generated. 

Step 6: means of measurement—This step makes sense out of the 
preceding pieces. A general, how-to action statement is written that 
describes how the elements of measure and their associated parameters 
will be applied to determine the achievement level in the performance 
indicator. This statement can be brief, but clarifying intent is more impor- 
tant than the length. 

Step 7: notional metrics—In this step, conceptual descriptions of possi- 
ble metrics resulting from the previous steps are put in writing. This step 
allows everyone to agree on the concept of how the information compiled 
in the previous steps will be applied to measuring organizational perfor- 
mance. It provides a basis for validating the process and for subsequently 
developing specific metrics. 

Step 8: specific metrics—In this final step, an operational definition and 
a functional description of the metrics to be applied are written. The 
definition and description describe the data, how they are collected, 
how they are used, and, most importantly, what the data mean or how 
they affect organizational performance. A prototype display of real or 
imaginary data and a descriptive scenario that shows what actions 
might be taken as a result of the measurement are also made. This last 
step is the real test of any metric. It must identify what things need to 
be done and disclose conditions in sufficient detail to enable subsequent 
improvement actions. 


Rose presents an application of his model used by the U.S. Army Materiel 
Command, which is shown in Figure 2.1. 


SIX SIGMA VERSUS TRADITIONAL THREE SIGMA 
PERFORMANCE 


The traditional quality model of process capability differed from Six Sigma 
in two fundamental respects: 


1. 


It was applied only to manufacturing processes, while Six Sigma is 
applied to all important business processes. 

It stipulated that a “capable” process was one that hada process standard 
deviation of no more than one-sixth of the total allowable spread, 
where Six Sigma requires the process standard deviation be no more 
than one-twelfth of the total allowable spread. 


These differences are far more profound than one might realize. By address- 
ing all business processes Six Sigma not only treats manufacturing as part of a 
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Application of the Performance Measurement Model 


Organizational performance metrics 


Performance category: Material acquisition 


Performance goal: Provide technologically superior equipment in the shortest possible time, 
while ensuring best value in all procurements. 


Performance Elements of Parameters Means of Notional metrics Specific metrics 
indicator measure measurement 


Industrial base man- Source of supply for Material and services Determine the level Number and (Separate package 
agement (assessing material and services requirements of industrial base capacity of existing containing operational 
and assuring adequate support for required —_ and potential definitions; functional 
industrial facilities to Quality of suppliers Procurement policy materlal and services — sector suppliers descriptions of data 
meet military needs) vs. material collection, use, and 
Certify the quality of — requirements meaning; and prototype 

(Other performance existing and potentiat display) 
indicators) suppliers Percentage of 

quality-certified 

sector suppliers 


(Other performance categories and goais) 


(Optional: subordinate organizational performance metrics) 


Figure 2.1. Organizational performance metrics. 
From “A performance measurement model,” by Kenneth H. Rose. Quality Progress, 
February 1995, p.65. Reprinted by permission. 


larger system, it removes the narrow, inward focus of the traditional approach. 
Customers care about more than just how well a product is manufactured. 
Price, service, financing terms, style, availability, frequency of updates and 
enhancements, technical support, and a host of other items are also important. 
Also, Six Sigma benefits others besides customers. When operations become 
more cost-effective and the product design cycle shortens, owners or investors 
benefit too. When employees become more productive their pay can be 
increased. Six Sigma’s broad scope means that it provides benefits to all stake- 
holders in the organization. 

The second point also has implications that are not obvious. Six Sigma is, 
basically, a process quality goal, where sigma is a statistical measure of vari- 
ability in a process. As such it falls into the category of a process capability 
technique. The traditional quality paradigm defined a process as capable if 
the process’s natural spread, plus and minus three sigma, was less than the 
engineering tolerance. Under the assumption of normality, this three sigma 
quality level translates to a process yield of 99.73%. A later refinement consid- 
ered the process location as well as its spread and tightened the minimum 
acceptance criterion so that the process mean was at least four sigma from 
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the nearest engineering requirement. Six Sigma requires that processes oper- 
ate such that the nearest engineering requirement is at least Six Sigma from 
the process mean. 

Six Sigma also applies to attribute data, such as counts of things gone wrong. 
This is accomplished by converting the Six Sigma requirement to equivalent 
conformance levels, as illustrated in Figure 2.2. 

One of Motorola’s most significant contributions was to change the discus- 
sion of quality from one where quality levels were measured in percent (parts- 
per-hundred), to a discussion of parts-per-million or even parts-per-billion. 
Motorola correctly pointed out that modern technology was so complex that 
old ideas about “acceptable quality levels’ could no longer be tolerated. 
Modern business requires near perfect quality levels. 

One puzzling aspect of the “official” Six Sigma literature is that it states that 
a process operating at Six Sigma will produce 3.4 parts-per-million (PPM) non- 
conformances. However, if a special normal distribution table is consulted 
(very few go out to Six Sigma) one finds that the expected non-conformances 
are 0.002 PPM (2 parts-per-billion, or PPB). The difference occurs because 
Motorola presumes that the process mean can drift 1.5 sigma in either direction. 
The area of a normal distribution beyond 4.5 sigma from the mean is indeed 3.4 
PPM. Since control charts will easily detect any process shift of this magnitude 
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Figure 2.2. Sigma levels and equivalent conformance rates. 
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in a single sample, the 3.4 PPM represents a very conservative upper bound on 
the non-conformance rate. 

In contrast to Six Sigma quality, the old three sigma quality standard of 
99.73% translates to 2,700 PPM failures, even if we assume zero drift. For pro- 
cesses with a series of steps, the overall yield is the product of the yields of the dif- 
ferent steps. For example, if we had a simple two step process where step 7/1 
had a yield of 80% and step #2 had a yield of 90%, then the overall yield would 
be 0.8 x 0.9 = 0.72 = 72%. Note that the overall yield from processes invol- 
ving a series of steps is always less than the yield of the step with the lowest 
yield. If three sigma quality levels (99.97% yield) are obtained from every step 
in a ten step process, the quality level at the end of the process will contain 
26,674 defects per million! Considering that the complexity of modern pro- 
cesses is usually far greater than ten steps, it is easy to see that Six Sigma quality 
isn’t optional, it’s required if the organization is to remain viable. 

The requirement of extremely high quality is not limited to multiple-stage 
manufacturing processes. Consider what three sigma quality would mean if 
applied to other processes: 

¢ Virtually no modern computer would function. 

¢ 10,800,000 mishandled healthcare claims each year. 

¢ 18,900 lost U.S. savings bonds every month. 

¢ 54,000 checks lost each night by a single large bank. 

e 4,050 invoices sent out incorrectly each month by a modest-sized telecom- 

munications company. 

¢ 540,000 erroneous call detail records each day from a regional telecommu- 

nications company. 

¢ 270,000,000 (270 million) erroneous credit card transactions each year in 

the United States. 

With numbers like these, it’s easy to see that the modern world demands 
extremely high levels of error free performance. Six Sigma arose in response to 
this realization. 


THE BALANCED SCORECARD 


Given the magnitude of the difference between Six Sigma and the traditional 
three sigma performance levels, the decision to pursue Six Sigma performance 
obviously requires a radical change in the way things are done. The organization 
that makes this commitment will never be the same. Since the expenditure of 
time and resources will be huge, it is crucial that Six Sigma projects and activ- 
ities are linked to the organization’s top-level goals. It is even more important 
that these be the right goals. An organization that uses Six Sigma to pursue the 
wrong goals will just get to the wrong place more quickly. The organization’s 
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goals must ultimately come from the constituencies it serves: customers, share- 
holders or owners, and employees. Focusing too much on the needs of any one 
of these groups can be detrimental to all of them in the long run. For example, 
companies that look at shareholder performance as their only significant goal 
may lose employees and customers. To use the balanced scorecard senior man- 
agement must translate these stakeholder-based goals into metrics. These goals 
and metrics are then mapped to a strategy for achieving them. Dashboards are 
developed to display the metrics for each constituency or stakeholder. Finally, 
Six Sigma is used to either close gaps in critical metrics, or to help develop new 
processes, products and services consistent with top management’s strategy. 
Balanced scorecards help the organization maintain perspective by providing 
a concise display of performance metrics in four areas that correspond roughly 
to the major stakeholders—customer, financial, internal processes, and learning 
and growth (Kaplan and Norton, 1992). The simultaneous measurement from 
different perspectives prevents local suboptimization, the common phenom- 
enon where performance in one part of the organization is improved at the 
expense of performance in another part of the organization. This leads to the 
well-known loop where this year we focus on quality, driving up costs. Next year 
we focus on costs, hurting cycle time. When we look at cycle time people take 
short cuts, hurting quality. And so on. This also happens ona larger scale, where 
we alternately focus on employees, customers, or shareholders at the expense of 
the stakeholders who are not the current focus. Clearly, such “firefighting” 
doesn’t make anyone happy. We truly need the “balance” in balanced scorecards. 
Well-designed dashboards include statistical guidance to aid in interpreting 
the metrics. These guidelines most commonly take the form of limits, the calcu- 
lation of which are discussed in detail elsewhere in this book. Limits are statisti- 
cally calculated guidelines that operationally define when intervention is 
needed. Generally, when metrics fall within the limits, the process should be 
left alone. However, when a metric falls outside of the limits, it indicates that 
something important has changed that requires attention. An exception to 
these general rules occurs when a deliberate intervention is made to achieve a 
goal. In this case the metric is supposed to respond to the intervention by moving 
in a positive direction. The limits will tell leadership if the intervention pro- 
duced the desired result. If so, the metric will go beyond the proper control 
limit indicating improvement. Once the metric stabilizes at the new and 
improved level, the limits should be recalculated so they can detect slippage. 


Measuring causes and effects 


Dashboard metrics are measurements of the results delivered by complex 
processes and systems. These results are, in a sense, “effects” caused by things 
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taking place within the processes. For example, “cost per unit” might be a 
metric on a top-level dashboard. This is, in turn, composed of the cost of materi- 
als, overhead costs, labor, etc. Cost of materials is a “cause” of the cost per 
unit. Cost of materials can be further decomposed into, say, cost of raw materi- 
als, cost of purchased sub-assemblies, etc. and so on. At some level we reach a 
“root cause,” or most basic reason behind an effect. Black Belts and Green 
Belts learn numerous tools and techniques to help them identify these root 
causes. However, the dashboard is the starting point for the quest. 

In Six Sigma work, results are known as “Ys” and root causes are known as 
Xs.” Six Sigma’s historical roots are technical and its originators generally 
came from engineering and scientific backgrounds. In the mathematics taught 
to engineers and scientists equations are used that often express a relationship 
in the form: 


ce 


Y =f(X) (2.1) 


This equation simply means that the value identified by the letter Y is deter- 
mined as a function of some other value X. The equation Y = 2X means that if 
we know what X is, we can find Y if we multiply X by 2. If X is the temperature 
of a solution, then Y might be the time it takes the solution to evaporate. 
Equations can become more complicated. For example, Y = f(Xj, X2) indicates 
that the value Y depends on the value of two different X variables. You should 
think of the X in Equation 2.1 as including any number of X variables. There 
can be many levels of dashboards encountered between the top-level Y, called 
the “Big Y,” and the root cause Xs. In Six Sigma work some special notation 
has evolved to identify whether a root cause is being encountered, or an inter- 
mediate result. Intermediate results are sometimes called “Little Ys.” 

In these equations think of Y as the output of a process and the Xs as inputs. 
The process itself is symbolized by the (). The process can be thought of as a 
transfer function that converts inputs into outputs in some way. An analogy is 
a recipe. Here’s an example: 


Corn Crisp Recipe 
12 servings 
3 cup yellow stone-ground cornmeal 
1 cup boiling water 
5 teaspoon salt 
3 tablespoons melted butter 


Preheat the oven to 400°F. Stir the cornmeal and boiling water together in a 
large glass measuring cup. Add the salt and melted butter. Mix well and 
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pour onto a cookie sheet. Using a spatula, spread the batter out as thin as you 
possibly can—the thinner the crisper. Bake the cornmeal for half an hour or 
until crisp and golden brown. Break into 12 roughly equal pieces. 


Here the Big Y is the customer’s overall satisfaction with the finished corn 
crisp. Little Ys would include flavor ratings, “crunchiness” rating, smell, fresh- 
ness, and other customer-derived metrics that drive the Big Y. Xs that drive the 
little Ys might include thinness of the chips, the evenness of the salt, the size of 
each chip, the color of the chip, and other measurements on the finished pro- 
duct. Xs could also be determined at each major step, e.g., actual measurement 
of the ingredients, the oven temperature, the thoroughness of stirring, how 
much the water cools before it is stirred with the cornmeal, actual bake time, 
etc. Xs would also include the oven used, the cookware, utensils, etc. 

Finally, the way different cooks follow the recipe is the transfer function or 
actual process that converts the ingredients into corn crisps. Numerous sources 
of variation (more Xs) can probably be identified by observing the cooks in 
action. Clearly, even such a simple process can generate some very interesting 
discussions. If you haven’t developed dashboards it might be worthwhile to do 
so for the corn crisps as a practice exercise. 

Figure 2.3 illustrates how dashboard metrics flow down until eventually 
linking with Six Sigma projects. 


Information systems 


Balanced scorecards begin with the highest level metrics. At any given level, 
dashboards will display a relatively small number of metrics. While this allows 
the user of the dashboard to focus on key items, it also presents a problem 
when the metric goes outside a control limit for reasons other than deliberate 
management action. When this happens the question is: Why did this metric 
change? Information systems (IS) can help answer this question by providing 
“drill down” capability. Drill down involves disaggregating dashboard metrics 
into their component parts. For example, a cost-per-unit metric can be decom- 
posed by division, plant, department, shift, worker, week, etc. These compo- 
nents of the higher-level metric are sometimes already on dashboards at lower 
levels of the organization, in which case the answer is provided in advance. 
However, if the lower-level dashboard metrics can’t explain the situation, 
other exploratory drill downs may be required. On-line analytic processing 
(OLAP) cubes often ease the demands on the IS caused by drill down requests. 

This raises an important point: in Six Sigma organizations the IS must be 
accessed by many more people. The attitude of many IS departments is “The 
data systems belong to us. If you want some data, submit a formal request.” In 
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Figure 2.3. Flowdown of strategies to drivers and projects. 


a Six Sigma organization, this attitude is hopelessly outmoded. The demands on 
the IS increase dramatically when Six Sigma is deployed. In addition to the crea- 
tion of numerous dashboards, and the associated drill downs and problem 
investigations, the Black Belts and Green Belts make frequent use of IS in their 
projects. Six Sigma “show me the data” emphasis places more demands on the 
IS. In planning for Six Sigma success, companies need to assign a high-level 
champion to oversee the adaptation of the IS to the new realities of Six Sigma. 
A goal is to make access as easy as possible while maintaining data security and 
integrity. 

Although it’s important to be timely, most Six Sigma data analyses don’t 
require real-time data access. Data that are a day or a few days old will often suf- 
fice. The IS department may want to provide facilities for off-line data analysis 
by Six Sigma team members and Belts. A few high-end workstations capable of 
handling large data sets or intensive calculations are also very useful at times, 
especially for data mining analyses such as clustering, neural networks, or classi- 
fication and decision trees. 


Customer perspective 
Let’s take a closer look at each of the major perspectives on the balanced 
scorecard, starting with the customer. The balanced scorecard requires that 
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management translate their vague corporate mission (“Acme will be #1 in 
providing customer value”) into specific measures of factors that matter to 
customers. The customer scorecard answers the question: “How do our custo- 
mers view us?” 

To answer this, you must ask yourself two related questions: What things do 
customers consider when evaluating us? How do we know? While the only 
true way to answer these questions is to communicate with real customers, it is 
well established that customers in general tend to consider four broad categories 
of factors when evaluating an organization: 

© Quality. How well do you keep your promises by delivering error free 

service or defect free product. Did I receive what I ordered? Was it 
undamaged? Are your promised delivery times accurate? Do you honor 
your warranty or pay your claims without a hassle? 

¢ Timeliness. How fast is your service? How long does it take to have my 

order delivered? Do improvements appear in a timely manner? 

¢ Performance and service. How do your products and services help me? Are 

they dependable? 

¢ Value. What is the cost of buying and owning your product or service? Is it 

worth it? 

The first step in the translation is to determine precisely what customers con- 
sider when evaluating your organization. This can be done by communicating 
with customers via one-on-one contacts, focus groups, questionnaires, chat 
rooms, forums, etc. Management should see the actual, unvarnished words 
used by customers to describe what they think about the company, its products, 
and its services. Once management is thoroughly familiar with their target cus- 
tomer, they need to articulate their customer goals in words meaningful to 
them. For example, management might say: 

¢ We will cut the time required to introduce a new product from 9 months 

to 3 months. 

¢ We will be the best in the industry for on-time delivery. 

¢ We will intimately involve our customers in the design of our next major 

product. 

These goals must be operationalized by designating metrics to act as surro- 
gates for the goals. Think of the goals themselves as /atent or hidden constructs. 
The objective is to identify observable things directly related to the goals that 
can be measured. These are indicators that help guide you towards your goals. 
Table 2.1 shows examples of how the goals mentioned above might be operatio- 
nalized. 

These goals are key requirements that employees will be asked to achieve. It is 
crucial that they not be set arbitrarily. More will be said about this later in this 
chapter (see ‘Setting organizational key requirements’). 
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Table 2.1. Operationalizing goals. 


Goal Candidate Metrics 

We will cut the time required to e Average time to introduce a new product 

introduce a new product from 9 months for most recent month or quarter 

to 3 months ¢ Number of new products introduced in 
most recent quarter 

We will be the best in the industry for ¢ Percentage of on-time deliveries 

on-time delivery ¢ Best in industry on-time delivery percentage 
divided by our on-time delivery percentage 

Percentage of late deliveries 

We will intimately involve our ¢ Number of customers on design team(s) 

customers in the design of our next ¢ Number of customer suggestions 

major product incorporated in new design 


Internal process perspective 


In the Internal Process section of the balanced scorecard we develop metrics 
that help answer the question: What internal processes must we excel at? 
Internal process excellence is linked to customer perceived value, but the link- 
age is indirect and imperfect. It is often possible to hide internal problems 
from customers by throwing resources at problems; for example, increased 
inspection and testing. Also, customer perceived value is affected by factors 
other than internal processes such as price, competitive offerings, etc. 
Similarly, internal operations consume resources so they impact the share- 
holders. Here again, the linkage is indirect and imperfect. For example, some- 
times it is in the organization’s strategic interest to drive up costs in order to 
meet critical short-term customer demands or to head off competitive moves 
in the market. Thus, simply watching the shareholder or customer dashboards 
won't always give leadership a good idea of how well internal processes are 
performing. A separate dashboard is needed for this purpose. 

This section of the scorecard gives operational managers the internal direc- 
tion they need to focus on customer needs. Internal metrics should be chosen 
to support the leadership’s customer strategy, plus knowledge of what custo- 
mers need from internal operations. Process maps should be created that show 
the linkage between suppliers, inputs, process activities, outputs and customers 
(SIPOC). SIPOC is a flowcharting technique that helps identify those processes 
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Internal Process 


Innovation 


Customer 
relationship 
management 


that have the greatest impact on customer satisfaction; it is covered elsewhere in 
this book. 

Companies need to identify and measure their core competencies. These are 
areas where the company must excel. It is the source of their competitive advan- 
tage. Goals in these areas must be ambitious and challenging. This where you 
“Wow” your customer. Other key areas will pursue goals designed to satisfy 
customers, perhaps by maintaining competitive performance levels. Table 2.2 
shows how core competencies might drive customer value propositions. The 
metrics may be similar for the different companies, but the goals will differ sig- 
nificantly. For example, Company A would place greater emphasis on the time 
required to develop and introduce new services. Companies B and C would 
not ignore this aspect of their internal operations, but their goals would be less 
ambitious in this area than Company A’s. Company A is the industry bench- 
mark for innovation. 

Of course, it is possible that your competitor will try to leapfrog you in your 
core competency, becoming the new benchmark and stealing your customers. 
Or you may find that your customer base is dwindling and the market for your 
particular competency is decreasing. Leadership must stay on the alert for such 
developments and be prepared to react quickly. Most companies will fight to 
maintain their position of industry leadership as long as there is an adequate 
market. Six Sigma can help in this battle because Six Sigma projects are usually 


Table 2.2. Customer value proposition versus core competency. 


Company A Company B Company C 


Operations and 
logistics 


Customer value Product or service Flexibility, Cost, 
proposition attributes customization dependability 


“X” indicates the company’s core competency. 
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of short duration strategically speaking, and Black Belts offer a resource that can 
be redeployed quickly to where they are most needed. 


Innovation and learning perspective 

In the Innovation and Learning Perspective section of the balanced scorecard 
we develop metrics that help answer the question: Can we continue to improve 
and create value? Success is a moving target. What worked yesterday may fail 
miserably tomorrow. Previous sections of the balanced scorecard have identi- 
fied the metrics the leadership considers to be most important for success in 
the near future. But the organization must be prepared to meet the new and 
changing demands that the more distant future will surely bring. Building share- 
holder value is especially dependent on the company’s ability to innovate, 
improve, and learn. The intrinsic value of a business is the discounted value of 
the cash that can be taken out of the business during its remaining life (Buffett, 
1996). Intrinsic value is directly related to a company’s ability to create new pro- 
ducts and processes, to improve operating efficiency, to discover and develop 
new markets, and to increase revenues and margins. Companies able to do this 
well will throw off more cash over the long term than companies that do it 
poorly. The cash generated can be withdrawn by the owners, or reinvested in 
the business. 

Innovation and learning were the areas addressed by the continuous 
improvement (CI) initiatives of the past. Devotees of CI will be happy to 
learn that it’s alive and well in the Six Sigma world. However, CI projects 
were often local in scope, while most Black Belt Six Sigma projects are cross- 
functional. Many so-called Green Belt projects (Six Sigma projects that don’t 
have a dedicated Black Belt on the project team) are reminiscent of the CI 
projects in the past. Also, CI tended to focus narrowly on work processes, 
while Green Belt projects cover a broader range of business processes, pro- 
ducts, and services. A well-designed Six Sigma program will have a mix of 
Green Belt and Black Belt projects addressing a range of enterprise and local 
process improvement issues. 

Dashboards designed to measure performance in the area of Innovation and 
Learning often address three major areas: employee competencies, technology, 
and corporate culture. These are operationalized in a wide variety of ways. 
One metric is the average rate of improvement in the sigma level of an organiza- 
tional unit. Six Sigma attempts to reduce mistakes, errors, and defects by a fac- 
tor of 10 every two years, which translates to about 17% per month. This 
breakthrough rate of improvement is usually not attained instantly and a metric 
of the actual rate is a good candidate for including on the Innovation and 
Learning dashboard. The rate of improvement is a measure of the overall matur- 
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ity of the Six Sigma initiative. Other Innovation and Learning metric candidates 
might include such things as: 

e Results of employee feedback 

¢ R&D cycle time 

¢ Closure of gaps identified in the training needs audit 


Financial perspective 


Obsession with financial metrics has been the undoing of many improve- 
ment initiatives. When senior leaders look only at results they miss the fact 
that these results come from a complex chain of interacting processes that effec- 
tively and efficiently produce value for customers. Only by providing value 
that customers are willing to pay for can an enterprise generate sales, and only 
by creating these values at a cost less than their price can it produce profits for 
owners. For many companies the consequence of looking only at short-term 
financial results has been a long-term decline in business performance. Many 
companies have gone out of business altogether. 

The result of this unfortunate history is that many critics have advocated the 
complete abandonment of the practice of using financial metrics to guide lea- 
dership action. The argument goes something like this: since financial results 
are determined by a combination of customer satisfaction and the way the orga- 
nization runs its internal operations, if we focus on these factors the financial 
performance will follow in due course. This is throwing the baby out with the 
bathwater. The flaw in the logic is that it assumes that leaders and managers 
know precisely how customer satisfaction and internal operational excellence 
lead to financial results. This arrogance is unjustified. Too often we learn in ret- 
rospect that we are focusing on the wrong things and the financial results fail 
to materialize. For example, we may busily set about improving the throughput 
of a process that already has plenty of excess capacity. All we get from this effort 
is more excess capacity. Many Six Sigma improvements don’t result in bottom- 
line impact because management fails to take the necessary steps such as 
reducing excess inventory, downsizing extra personnel, selling off unneeded 
equipment, etc. As Toyota’s Taiichi Ohno says: 


If, as a result of labor saving, 09 0f.a worker is saved, it means nothing. At 
least one person must be saved before a cost reduction results. Therefore, 
we must attain worker saving. 


Taiichi Ohno 
Toyota Production System: Beyond Large-Scale Production 


The truth is, it’s very difficult to lay people off and a poor reward for people 
who may have participated in creating the improvement. Most managers agree 
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that this is the worst part of their job. However, simply ignoring the issue isn’t 
the best way to deal with it. Plans must be made before starting a project for 
adjusting to the consequences of success. If there will be no bottom-line impact 
because there are to be no plans to convert the savings into actual reductions 
in resource requirements, the project shouldn’t be undertaken in the first 
place. On the other hand, plans can often be made at the enterprise level for deal- 
ing with the positive results of Six Sigma by such means as hiring moratoriums, 
early retirement packages, etc. Better still are plans to increase sales or to grow 
the business to absorb the new capacity. This can often be accomplished by 
modifying the customer value proposition through more reliable products, 
lower prices, faster delivery time, lower cycle times, etc. These enhancements 
are made possible as a result of the Six Sigma improvements. 

There are other ways to go wrong if financial results are not explicitly moni- 
tored. We may blindly pour resources into improving customer satisfaction as 
measured by a faulty or incomplete survey. Or the competition may discover a 
new technology that makes ours obsolete. The list of things that can break the 
link between internal strategies and financial performance is endless. Financial 
performance metrics provide us with the feedback we need to assure that we 
haven’t completely missed the boat with our assumptions. 

Actual metrics for monitoring financial performance are numerous. The top- 
level dashboard will often include metrics in the areas of improved efficiency 
(e.g., cost per unit, asset utilization) or improved effectiveness (e.g., revenue 
growth, market share increase, profit per customer). 


STRATEGY DEPLOYMENT PLAN 


Unlike traditional measurement systems, which tend to have a control bias, 
balanced scorecards are based on strategy. The idea is to realize the leadership 
vision using a set of linked strategies. Metrics operationalize these strategies 
and create a bond between the activities of the organization and the vision of 
the leadership. 

Figure 2.4 illustrates these principles for a hypothetical organization. Things 
that will actually be measured are shown in rectangles. The dashboard metrics 
appear on the left side of the figure. The strategy deployment plan makes it clear 
that the metrics are not ends in themselves, they are merely measurements of big- 
ger items of interest. These unobserved, or latent constructs are shown in ellipses 
and are inferred from the metrics. This perspective helps leadership understand 
the limitations of metrics, as well as their value. If, for example, all of the metrics 
leading to shareholder perceived value are strongly positive, but surveys of the 
shareholders (Voice of Shareholder) indicate shareholder dissatisfaction, then 
the dashboard metrics are obviously inadequate and need to be revised. 
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Figure 2.4. Strategy deployment plan for a hypothetical organization. 
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The organization is pursuing a particular strategy and emphasizing certain 
dashboard metrics, which are shown in boldface type. Goals for these metrics 
will be set very high in an attempt to differentiate this organization from its 
competition. Goals for other metrics (key requirements) will be set to achieve 
competitiveness. Usually this means to maintain historical levels for these 
metrics. 

The organization’s leaders believe their core competencies are in the areas of 
technology and customer service. They want their customers to think of them as 


The company to go to for the very best products completely customized to 
meet extremely demanding needs. 


However, note that the organization’s differentiators are: 
Cost per unit 

Revenues from new sources 

[Customer] service relationship 

Product introductions, [new product] revenues 
Research deployment time 

It appears that item 1 is inconsistent with the leadership vision. Most peo- 
ple would be confused if asked to achieve benchmark status for items 2—5 as 
well as for item 1. The plan indicates that the productivity strategy for this 
organization should be reevaluated. Unless the company is losing its market 
due to uncompetitive prices, or losing its investors due to low profits, item 1 
should probably be a key requirement maintained at historical levels. If costs 
are extremely out of line, cost per unit might be the focus of a greater than 
normal amount of attention to bring it down to reasonable levels. However, 
it should not be shown as a differentiator on the strategic dashboard. The 
company has no desire to become a cost leader in the eyes of customers or 
shareholders. 

Six Sigma plays a vital role in achieving the leadership vision by providing the 
resources needed to facilitate change where it is needed. Six Sigma projects are 
linked to dashboard metrics through the project selection process discussed 
elsewhere in this book. The process involves calculating the expected impact of 
the project on a dashboard metric. The metrics used for Six Sigma projects are 
typically on a lower-level dashboard, but since the lower-level dashboard 
metrics flow down from the top level, the linkage is explicit. The process begins 
by identifying the gap between the current state and the goal for each top-level 
dashboard metric; Master Black Belts commonly assist with this activity. Six 
Sigma projects impacting differentiator dashboard metrics which show large 
gaps are prime candidates. This determination is usually done by Master Black 
Belts. This information is also very useful in selecting Black Belt candidates. 
Candidates with backgrounds in areas where high-impact projects will be 
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pursued may be given preference over equally qualified candidates from else- 
where in the organization. 


INFORMATION SYSTEMS REQUIREMENTS 


Six Sigma technical leaders work to extract actionable knowledge from an 
organization’s information warehouse. To assure access to the needed infor- 
mation, Six Sigma activities should be closely integrated with the information 
systems (IS) of the organization. Obviously, the skills and training of Six 
Sigma technical leaders must be supplemented by an investment in software 
and hardware. It makes little sense to hamstring these experts by saving a few 
dollars on computers or software. Six Sigma often requires the analysis of huge 
amounts of data using highly sophisticated algorithms. The amount of time 
required to perform the analysis can be considerable, even with today’s 
advanced processing equipment. Without state-of-the-art tools, the situation is 
often hopeless. 


Integrating Six Sigma with other information 
systems technologies 


There are three information systems topics that are closely related to Six 
Sigma activities: 

e Data warehousing 

* On-line Analytic Processing (OLAP) 

e Data mining 

The first topic relates to what data is retained by the organization, and there- 
fore available for use in Six Sigma activities. It also impacts on how the data is 
stored, which impacts on ease of access for Six Sigma analyses. OLAP enables 
the analysis of large databases by persons who may not have the technical back- 
ground of a Six Sigma technical leader. Data mining involves retrospective ana- 
lysis of data using advanced tools and techniques. Each of these subjects will 
be discussed in turn. 


DATA WAREHOUSING 


Data warehousing has progressed rapidly. Virtually non-existent in 1990, 
now every large corporation has at least one data warehouse and some have sev- 
eral. Hundreds of vendors offer data warehousing solutions, from software to 
hardware to complete systems. Few standards exist and there are as many data 
warehousing implementations as there are data warehouses. However, the 
multitiered approach to data warehousing is a model that appears to be gaining 
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favor and recent advances in technology and decreases in prices have made this 
option more appealing to corporate users. 

Multitiered data warehousing architecture focuses on how the data are used in 
the organization. While access and storage considerations may require sum- 
marization of data into multiple departmental warehouses, it is better for Six 
Sigma analysis if the warehouse keeps all of the detail in the data for historical 
analysis. The major components of this architecture are (Berry and Linoff, 1997): 

© Source systems are where the data come from. 

e Data transport and cleansing move data between different data stores. 

¢ The central repository is the main store for the data warehouse. 

¢ The metadata describes what is available and where. 

¢ Data marts provide fast, specialized access for end users and applications. 

¢ Operational feedback integrates decision support back into the opera- 

tional systems. 

e End users are the reason for developing the warehouse in the first place. 

Figure 2.5 illustrates the multitiered approach. 

Every data warehouse includes at least one of these building blocks. The data 
originates in the source systems and flows to the end users through the various 
components. The components can be characterized as hardware, software, and 
networks. The purpose is to deliver information, which is in turn used to create 
new knowledge, which is then acted on to improve business performance. In 
other words, the data warehouse is ultimately a component in a decision- 
support system. 


OLAP 


On-line analytic processing, or OLAP, is a collection of tools designed to 
provide ordinary users with a means of extracting useful information from 
large databases. These databases may or may not reside in a data warehouse. 
If they do, then the user obtains the benefit of knowing the data has already 
been cleansed, and access is likely to be more efficient. OLAP consists of 
client-server tools that have an advanced graphical interface that accesses 
data arranged in “cubes.” The cube is ideally suited for queries that allow 
users to slice-and-dice the data in any way they see fit. OLAP tools have 
very fast response times compared to SQL queries on standard relational 
databases. 

The basic unit of OLAP is the cube. An OLAP cube consists of subcubes that 
summarize data from one or more databases. Each cube is composed of multiple 
dimensions which represent different fields in a database. For example, an 
OLAP cube might consist of warranty claims arranged by months, products, 
and region, as shown in Figure 2.6. 
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Figure 2.5. The multitiered approach to data warehousing. 
From Data Mining Techniques for Marketing, Sales, and Customer Support, by Michael J.A. 
Berry and Gordon Linoff, New York, John Wiley and Sons, 1997. Used by permission of the 
publisher. 


DATA MINING 


Data mining is the exploration and analysis by automatic or semi-automatic 
means of large quantities of data in order to uncover useful patterns. These pat- 
terns are studied in order to develop performance rules, ie., new and better 
ways of doing things. Data mining, as used in Six Sigma, is directed toward 
improving customer satisfaction, lowering costs, reducing cycle times, and 
increasing quality. 

Data mining is a grab-bag of techniques borrowed from various disciplines. 
Like Six Sigma, data mining alternates between generating questions via knowl- 
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Figure 2.6. An OLAP cube. 


edge discovery, and testing hypotheses via designed experiments. Six Sigma and 
data mining both look for the same things in evaluating data, namely classifi- 
cation, estimation, prediction, affinity grouping, clustering and description. 
However, data mining tends to use a different set of tools than traditional Six 
Sigma tools and therefore it offers another way to look for improvement oppor- 
tunities. Also, where Six Sigma tends to focus on internal business processes, 
data mining looks primarily at marketing, sales, and customer support. Since 
the object of Six Sigma is, ultimately, to improve customer satisfaction, the 
external focus of data mining provides both feed forward data to the Six Sigma 
program and feed back data on its success. 

Data mining is a process for retrospectively exploring business data. There is 
growing agreement on the steps involved in such a process and any differences 
relate only to the detailed tasks within each stage.* 

Goal definition—This involves defining the goal or objective for the data 
mining project. This should be a business goal or objective which nor- 
mally relates to a business event such as arrears in mortgage repayment, 
customer attrition (churn), energy consumption in a process, etc. This 
stage also involves the design of how the discovered patterns will result 
in action that leads to business improvement. 

Data selection—This is the process of identifying the data needed for the 
data mining project and the sources of these data. 

Data preparation—This involves cleansing the data, joining/merging 
data sources and the derivation of new columns (fields) in the data 
through aggregation, calculations or text manipulation of existing 
data fields. The end result is normally a flat table ready for the 
application of the data mining itself (ie. the discovery algorithms 
to generate patterns). Such a table is normally split into two data 


*http://www.attar.com/tutor/deploy.htm. 
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sets; one set for pattern discovery and one set for pattern verifica- 
tion. 

Data exploration—This involves the exploration of the prepared data to get 
a better feel prior to pattern discovery and also to validate the results 
of the data preparation. Typically, this involves examining descriptive 
statistics (minimum, maximum, average, etc.) and the frequency distri- 
bution of individual data fields. It also involves field versus field scatter 
plots to understand the dependency between fields. 

Pattern discovery—This is the stage of applying the pattern discovery algo- 
rithm to generate patterns. The process of pattern discovery is most 
effective when applied as an exploration process assisted by the discov- 
ery algorithm. This allows business users to interact with and to impart 
their business knowledge to the discovery process. For example, if 
creating a classification tree, users can at any point in the tree construc- 
tion examine/explore the data filtering to that path, examine the 
recommendation of the algorithm regarding the next data field to use 
for the next branch then use their business judgment to decide on the 
data field for branching. The pattern discovery stage also involves ana- 
lyzing the ability to predict occurrences of the event in data other than 
those used to build the model. 

Pattern deployment—This stage involves the application of the discovered 
patterns to solve the business goal of the data mining project. This can 
take many forms: 

Pattern presentation—The description of the patterns (or the graphical 
tree display) and their associated data statistics are included in a docu- 
ment or presentation. 

Business intelligence—The discovered patterns are used as queries against a 
database to derive business intelligence reports. 

Data scoring and labeling—The discovered patterns are used to score and/ 
or label each data record in the database with the propensity and the 
label of the pattern it belongs to. 

Decision support systems—The discovered patterns are used to make com- 
ponents of a decision support system. 

Alarm monitoring—The discovered patterns are used as norms for a busi- 
ness process. Monitoring these patterns will enable deviations from 
normal conditions to be detected at the earliest possible time. This 
can be achieved by embedding the data mining tool as a monitoring 
component, or through the use of a classical approach, such as con- 
trol charts. 

Pattern validity monitoring—As a business process changes over time, the 
validity of patterns discovered from historic data will deteriorate. It is 
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therefore important to detect these changes at the earliest possible time 
by monitoring patterns with new data. Significant changes to the 
patterns will point to the need to discover new patterns from more 
recent data. 


OLAP, data mining, and Six Sigma 

OLAP is not a substitute for data mining. OLAP tools are a powerful means 
for reporting on data, while data mining focuses on finding hidden patterns in 
data. OLAP helps users explore theories they already have by quickly present- 
ing data to confirm or disconfirm ad hoc hypotheses, obviously a valuable 
knowledge discovery tool for Six Sigma teams. It is, essentially, a semi-auto- 
mated means of analysis. OLAP and data mining are complementary, and both 
approaches complement the standard arsenal of tools and techniques used in 
Six Sigma. Both OLAP and data mining are used for retrospective studies, that 
is, they are used to generate hypotheses by examining past data. Designed 
experiments help users design prospective studies, that is, they test the hypoth- 
eses generated by OLAP and data mining. Used together, Six Sigma, data 
mining and OLAP comprise a powerful collection of business improvement 
tools. 


DASHBOARD DESIGN 


Strategies are operationalized by metrics which are displayed on dash- 
boards. Dashboard displays should be designed to provide the needed infor- 
mation in a way that is standardized throughout the organization. A process 
owner at any level of the organization should be able to look at any dashboard 
and quickly recognize the meaning of the data. The purpose of data displays 
is to accelerate the learning cycle. The strategy deployment plan is merely a 
hypothesis. Science-based management requires that we test this hypothesis 
to determine if it is in reasonable agreement with the facts, and take action 
or revise the strategy deployment plan or the strategy accordingly. The cycle 
works as follows: 

1. Formulate a strategy (hypothesis). 

Develop metrics to operationalize the strategy. 

Deploy the strategy. 

Collect data for the metrics. 

Analyze the data to extract information regarding the effectiveness of the 
strategy deployment plan. This includes the use of statistical tools and 
techniques, graphs and charts, discussion of results, etc. 
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6. Think about the result indicated by the information and whether it vali- 
dates or invalidates the strategy and/or the metrics used to operation- 
alize it. 

7. Take appropriate action. This may be no action (the null option), 
revision of the strategy, revision of the metrics, or some other steps. 

This process is illustrated in Figure 2.7. 

Dashboard metrics should embody all of the general principles of good 
metrics discussed earlier. More specifically, dashboards should: 

¢ Display performance over time. 

* Include statistical guidelines to help separate signal (variation from an 

identifiable cause) from noise (variation similar to random fluctuations). 
¢ Show causes of variation when known. 

° Identify acceptable and unacceptable performance (defects). 

* Be linked to higher-level dashboards (goals and strategies) or lower-level 

dashboards (drivers) to guide strategic activity within the organization. 

Although all dashboards should conform to these guidelines, different dash- 
board formats are needed for data on different scales of measurement (see 
Chapter 9). Because of the nature of measurement scales, some data contain 
more information than other data. For example, we might be interested in the 
size of a hole that will have a bushing pressed into it. If the hole is too large, the 
bushing will be loose and it will wear out quickly. If the hole is too small the 
bushing won’t fit at all. Assume that there are three different methods available 
for checking the hole size. 

Method #1 is a hole gage that measures the actual size of the hole. These 
data are called ratio data. This measurement scale contains the most infor- 
mation. Interval data such as time and temperature are often treated as if 
they were ratio data, which is usually acceptable for dashboards. In our dis- 
cussions of dashboards we will refer to both ratio and interval data as scale 
data. 

Method #2 is a set of four pin gages. One set of two pins determines if the 
hole is smaller than the minimum requirement, or larger than the maximum 
requirement. For example, if the hole size requirement is 1.000 to 1.010, then 
this set will determine if the hole is smaller than 1.000 or larger than 1.010. 
Another set of two pins determines if the hole is in the middle half of the require- 
ment range. For example, if the hole size requirement is 1.000 to 1.010, then 


Strategy ——> Action —> Results —-+ Data ——+ Information —+ Knowledge _ 


Figure 2.7. The learning cycle. 
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this set of pins will determine if the hole is smaller than 1.0025 or larger than 
1.0075. Thus, hole sizes will be classified by this measurement system as: 


Best: Middle half of requirements. 
Acceptable: Not in middle half, but still meets requirements. 
Reject: Does not meet requirements. 


These data are called ordinal data. That is, the measurements can be placed in 
an order of preference. Ordinal data don’t contain as much information as 
ratio data or interval data. For example, we can calculate the precise difference 
between two hole sizes if we know their measurements, but we can’t do so if 
we only know the hole size classification. 

Method #3 isa single pair of go/not-go pin gages: pins will be used to deter- 
mine if the hole meets the requirements or not. These are nominal data. 
Nominal data have less information than ratio, interval or ordinal data. 

Although dashboards are discussed in some detail and examples shown and 
interpreted, there are no hard and fast rules for dashboards. Any dashboard 
that displays metrics derived from strategic goals and conforming to the princi- 
ples of good metrics described above is acceptable, providing it supplies the 
information needed to make good decisions in a timely manner. You should 
avoid cookbook dashboard development and design dashboards that help you 
assure that your strategies are being effectively deployed and accomplishing 
your ultimate goals. 


Dashboards for scale data 


Data on these measurement scales contain the maximum amount of infor- 
mation. In fact, as the examples above show, it is a simple matter to derive 
ordinal or nominal metrics from scale data, but one cannot go in reverse. To 
take advantage of the information contained in scale data they should be 
viewed in a variety of different ways on the dashboards. Figure 2.8 provides 
guidelines. 

These different, but related views give a detailed picture of the performance 
of the metric. If annotated and linked to driver dashboards, the reason why the 
metric did what it did should be relatively easy to determine. 


EXAMPLE OF SCALE DATA DASHBOARD 

Figure 2.9 shows a dashboard for a fictitious customer service call center. The 
metric is speed of answer, which was decided upon based on customer input. It 
was determined from actual customer information that customers viewed 


82 


Stx SIGMA GOALS AND METRICS 


QUADI 
CENTRAL TENDENCY OVER 
TIME 

Process Behavior Chart of the metric 
in time order. E.g., by hour, day, week, 
or month. Generally an averages chart 
or equivalent. Learn by studying time- 
related patterns, outliers, etc. 


QUAD II 
RECENT PERFORMANCE 
DISTRIBUTION PATTERN 
Histogram showing distribution of the 
metric for the most recent time 

period. E.g., histogram of the most 
recent month. The requirement 
should be drawn on the histogram to 
identify defects. Learn by studying the 
frequency distribution pattern. 


QUAD III 
REQUIREMENTS PERSPECTIVE 
OVER TIME 

A Process Behavior Chart of the rate 
of defects or defectives in time-order. 
Learn by studying defect patterns. 


QUAD IV 

OUTLIER OR “TAILS” 
PERSPECTIVE 

A chart showing the distribution of 
individual defectives, such as a dotplot 
or box-and-whiskers charts. Le., an 
“ungrouping” of the defect data 
shown as grouped by the histogram. 
Learn by studying process changes 
designed to improve extremely poor 
customer experiences. 


Figure 2.8. Layout of a scale data dashboard. 


speed-to-answer times in excess of 6 minutes to be unacceptable, so this is 
defined as the requirement. 

Process central tendency: The chart in Quad I shows the average speed to 
answer (ASA) for the most recent month. The dashed lines are statistically 
calculated “limits,” which define the normal range of variability in ASA for 
this process (for additional information on averages’ charts, see Chapter 
12). The chart indicates that the process ASA is stable and averaging 3.2 
minutes. 

Distribution of calls: ASA is a good indicator of overall process control, but 
individual customers have individual experiences, so the average doesn’t mean 
much to them. The histogram in Quad II gives a better indication of the indivi- 
dual customer’s experience in the most recent week. The bar labeled “More” 
indicates the calls not meeting the customer requirement; it’s a pretty big bar. 
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Figure 2.9. Example of a scale data dashboard. 


Despite a process average of 3.2 minutes, approximately 15% of the calls 
answered this week were not answered within 6 minutes. 

Defectives over time: Okay, so we failed to meet the customer requirements 
15% of the time during this week. Is that due to some special circumstance 
that only happened once? The chart in Quad II shows the pattern of defec- 
tives over time; the dashed lines are limits for the percent not meeting 
requirements. The chart shows that the defective rate is stable and averaging 
15%. 

Outlier or tails perspective: Finally, a box-and-whiskers chart, or boxplots 
(see Chapter 11) is shown in Quad IV. The time scale is chopped off (trun- 
cated) at 6 minutes, since we are interested in learning about calls that failed 
to meet the requirement. In the plot, an “*” or an “o” is an individual call 
that is considered an outlier. The chart indicates that some people wait a 
very long time for the phone to be answered, but most get an answer within 
10 minutes. 


84 


Stx SIGMA GOALS AND METRICS 


INTERPRETATION 


It is important to note that although the speed-to-answer metric indicates a 
stable process mean, this may not be what management wants to see. In this 
case, it’s very unlikely that management will be satisfied with a process that con- 
sistently makes 15% of the customers wait too long for their call to be answered. 
This metric is a good candidate for one or more Six Sigma projects. The project 
Black Belt will no doubt drill down to lower level dashboards to attempt to iden- 
tify drivers to address during the project. For example, are there differences by 
department? By technician? 

The interpretation of the dashboard also depends on the strategy it operatio- 
nalizes. In this example, if the company is pursuing a strategy where process 
excellence is a primary driver, then the 6 minute requirement might not be suffi- 
cient. Instead of asking customers what level of service would satisfy them, the 
focus might be on the level of service that would delight them. Perhaps the com- 
pany’s leadership believes that some customers (e.g., professionals) would pay 
a premium price to have the phone answered immediately, in which case the 
metric of interest might be “percentage of calls not answered within three 
rings.” Staff levels could be increased because of the increased prices paid by 
these premier customers. 


Dashboards for ordinal data 


Figure 2.10 provides guidelines for ordinal data dashboards. These different, 
but related views give a detailed picture of the performance of the metric. If 
annotated and linked to driver dashboards, the reason why the metric did what 
it did should be relatively easy to determine. 


EXAMPLE OF ORDINAL DATA DASHBOARD 


Figure 2.11 shows a dashboard from a customer survey metric measuring 
how easy it is for the customer to contact the call center. 

Process central tendency: The chart in Quad I shows the weekly average ease 
of contact scores. This is the same type of chart used in Quad I for scale data 
dashboards, and it is used the same way. 

Distribution of ratings: Quad II shows the distribution of actual customer 
ratings. The customers had to choose a response on a five-point scale; higher 
numbered responses are better. Previous research had determined that custo- 
mers who gave a response below 4 were less likely to remain customers than 
those who scored easy-to-contact a 4 or better, so that’s where the defect line is 
drawn on the bar chart. Note that this isn’t a histogram because the data are 
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QUADI 

CENTRAL TENDENCY OVER 
TIME 

Process Behavior Chart of the metric 


in time order. E.g., by hour, day, week, 
or month. Generally an averages chart 
or equivalent. Learn by studying time- 
related patterns, outliers, etc. 


QUAD II 

RECENT PERFORMANCE 
DISTRIBUTION PATTERN 

Bar chart showing distribution of the 
metric for the most recent time 
period. E.g., bar chart of the most 
recent month. The requirement 
should be drawn on the bar chart to 
identify defects. Learn by studying the 
frequency distribution pattern. 


QUAD III 

REQUIREMENTS PERSPECTIVE 
OVER TIME 

A Process Behavior Chart of the rate 
of defects or defectives in time-order. 
Learn by studying defect patterns. 


QUAD IV 

ADDITIONAL INFORMATION 
Text, drawings, links to other 
documents, photos, maps or other 
information that lends meaning to the 
data. 


Figure 2.10. Layout of an ordinal data dashboard. 


not grouped. The bar at, say, 2 indicates the number of customers who rated 
easy-to-contact a 2. A large number of customers in this example rate ease of 
contact very low. 

Defectives over time: Quad III for ordinal data is a process behavior 
chart of the defective rate, just like it is in the scale data dashboard. Since 
defective rates are pass/fail data (did or did not meet the requirement), it 
is a nominal measurement and we can convert the ordinal data into nom- 
inal data for this chart. This chart shows that the defective rate for this 
call center is stable at 48%; ie, we consistently fail to meet the customer 
requirement. 

Outlier or tails perspective: Since we are analyzing the voice of the customer, 
leadership wanted to use Quad IV to display some actual customer comments. 
(Comments can also be statistically analyzed.) The comments highlight some 
problem areas that could become Six Sigma projects. Other problem areas 
have obvious solutions and can be addressed without Six Sigma projects. 
Don’t use a hammer to swat a fly! 
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Figure 2.11. Example of an ordinal data dashboard. 


INTERPRETATION 


Like speed-to-answer, the dashboard for easy-to-contact indicates a stable 
process mean at an unacceptable performance level. It may be that manage- 
ment is responsible for this situation, which is usually the case when a process 
is stable. The Six Sigma project may require a new process design. Stability 
means that there’s no point in looking for “problems.” If management isn’t 
happy with the results, the problem is the process itself. The process redesign 
should be linked to the overall strategy. This means, for example, if the strat- 
egy is to make the customer relationship a differentiator, then the goal for 
easy-to-contact should be set at or near a benchmark level. If it is a require- 
ment, then the goal should be set near the industry average. However, keep 
in mind that if the industry average is awful, then differentiation should be 
relatively easy to attain. 


Dashboard Design 87 


Dashboards for nominal data 


Nominal data, such as pass-fail, yes-no, acceptable-unacceptable, met goal- 
didn’t meet goal, are based on rates (e.g., failure rates), counts or proportions 
of counts. Unlike scale or ordinal data, nominal data can’t be further broken 
down into numbers on other scales. Typically, nominal data dashboards show 
defect metrics or, equivalently, success metrics. In many cases where defectives 
or failures are measured, non-defectives or non-failures provide identical infor- 
mation. 

Figure 2.12 provides guidelines for nominal data dashboards. Since there are 
limits to how much information can be obtained by analyzing nominal data 
directly, nominal data dashboards focus on providing background details. 
Also, since nominal metrics are so often measures of process failure, you may 
wish to devote part of the dashboard to descriptions of action being taken to 
improve the metric. 


QUAD I QUAD II 
REQUIREMENTS PERSPECTIVE ADDITIONAL INFORMATION 
OVER TIME A graph or table providing additional 
A Process Behavior Chart of the rate information regarding the metric. 


of defects or defectives in time-order. 


Learn by studying defect patterns. 


QUAD III QUADIV 

ADDITIONAL INFORMATION ADDITIONAL INFORMATION 

A graph or table providing additional Action plans, responsibilities, 

information regarding the metric. timetables, etc. for improving the 
metric. 


Figure 2.12. Layout of a nominal data dashboard. 


EXAMPLE OF NOMINAL DATA DASHBOARD 


Figure 2.13 shows a dashboard from a customer survey metric measuring 
the rate at which customer issues were unresolved after they spoke with a 
technician. Obviously, this can be considered a failure in terms of customer 
service. 

Defectives over time: Quad I for nominal data is a process behavior chart of 
the defective rate. This chart appears on the dashboards for scale and ordinal 
data too, but in later quads. In this example the chart shows that the non-resolu- 
tion rate for this call center is not stable. During one week the rate of unresolved 
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% NOT resolved on first contact 
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Figure 2.13. Problem resolution dashboard. 


problems dropped below the lower control limit. An investigation revealed that 
this was due to the fact that the problem mix was influenced by a national holi- 
day. This information provided a hint to management: problem resolution is 
influenced by the type of problem. Excluding the unusual week, the chart 
shows that on average about 11% of customer issues are unresolved. 

Bar chart of calls needed to resolve issues: Quad II looks more deeply into 
the process failure. Rather than simply count the number of unresolved custo- 
mer issues, this chart shows how many attempts customers made before 
their issues were resolved. This trial-and-error approach is frustrating to cus- 
tomers and costly to the enterprise. It indicates a fairly consistent drop-off in 
the frequency of customers who call back two or more times. Is this due to 
their problems being resolved, or frustration and eventual abandoning of the 
effort? This is a good question for a Black Belt to address as part of a Six 
Sigma project, but it isn’t answered by information on this particular dash- 


board. 
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Pareto analysis by call type: Tipped off by the holiday week outlier, leader- 
ship asked for an analysis by call type. This information is shown in Quad III. 
Corrupt data files account for nearly half of the unresolved customer issues, 
suggesting a possible area to be addressed by a Six Sigma project. 

Process FMEA: FMEA stands for Failure Mode and Effects Analysis. As the 
name suggests, FMEA is a tool that can be used to identify the way in which 
the process fails. Quad IV could be used to display such information. Once a 
project is underway to address issues identified by the FMEA, Quad IV could 
be used to track the project’s progress. FMEA is discussed in Chapter 16. 


INTERPRETATION 


This dashboard shows that there is a real opportunity to improve customer 
satisfaction. The key information is contained in the process behavior chart in 
Quad I. The long-term rate of unresolved issues of 11% is costing the company 
a lot of money, and frustrating customers. Each call beyond the first is pure 
waste. 


SETTING ORGANIZATIONAL KEY REQUIREMENTS 


Plans, budgets, goals and targets are key requirements set by the leadership 
for the organization. If not done properly, the behavior driven by these key 
requirements may not be anywhere close to what the leadership desires, or 
expects. Key requirements are used to assess employee performance, which is 
linked to promotions, pay increases, bonuses and many other things that people 
care about a great deal. People will try hard to meet the key requirements, but 
if the process they must work with makes it impossible to do so they will often 
cheat (see sidebar, Gaming the System). 

The most common flaw in goal setting, in my opinion, is the tendency to 
set goals that are merely wishes and hopes. The leadership looks at a metric 
and pontificates on what a “good” level of performance would be for it. 
If enough heads nod around the conference table, this becomes that metric’s 
target. 

A better way to arrive at goals for key requirements is to examine the actual 
history of the metric over time. This information should be plotted on a process 
behavior chart. If the metric falls within the calculated limits the bulk of the 
time, then the process is considered predictable. Typically, unless the metric is 
operationalizing a differentiation strategy, the goal for predictable processes 
will be to maintain the historical levels. These metrics will not appear on the 
dashboards that the leadership reviews on a routine basis. However, their 
performance is monitored by process owners and the leadership is informed if 
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Gaming the System 

It has been said that the managers of factories in the former Soviet Union didn’t fail 
to meet their numerical targets, rather that they met them too well. Is the quota for 
my shoe factory 100,000 pairs of shoes? Here are 100,000 pairs of baby shoes, the easiest 
to make. Change the quota to 10,000 pounds of shoes and the shoe factory manager 
will deliver 500 pairs of concrete boots. One advantage of balanced scorecards is that 
they make it more difficult to get away with “gaming the system” like this. Gaming the 
system involves the manipulation of metrics to reach numerical targets, rather than 
actually achieving the goals themselves. Of course, balanced scorecards can’t solve the 
problems inherent in communism, and the situation in our companies is nowhere near 
as bad. But we’ve all seen similar behavior when managers are given metrics for their 
local area and inadequate information about how the metrics fit into the grand scheme 
of things. 

Another common game that gets played is “denominator management.” Denominator 
management is the practice of manipulating the base of a metric, rather than doing the 
work necessary to change the underlying reality. Is my metric defects-per-million-opportu- 
nities? Well, reducing defects is difficult and time-consuming. I'll just manipulate the num- 
ber of opportunities. Table 2.3 below shows a few examples of this, creative gamers can 
come up with many more! 


Table 2.3. Examples of denominator management. 
Denominator Management Approach 


1. Reduce defective circuit 1. Count the number of components not 
boards the number of circuit boards 

2. Reduce customer billing 2. Count the lines (or words) on billing 
problems statements not the number of 

3. Improve time to introduce statements 
new products 3. Develop simple products 

4. Reduce setup costs 4. Increase batch sizes 

5. Improve process yields 5. Produce more simple parts 


By linking the metric to the strategic goal and by simultaneously monitoring all key dif- 
ferentiator metrics on the stakeholder dashboards, gaming is minimized. Six Sigma’s ratio- 
nalization of management also makes gaming more difficult. If, despite repeated warnings, 
some people persist in gaming the system, and assuming they are given the resources they 
need to meet the key requirements, they should be disciplined or terminated. Gaming is 
inherently dishonest and it has no place in the Six Sigma organization. 
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the process behavior becomes unpredictable. In other words, the reporting is on 
an exception basis. 

If process behavior charts indicate that a key requirement metric is not 
predictable, an investigation into the reason should ensue and the cause of the 
unpredictability should be corrected. 

Finally, if the key requirement metric is so far from generally accepted 
standards of performance that it demands action, a short-term project 
should be commissioned to address the issue. The project team should 
focus on identifying why performance is so far below the norm and on 
what needs to be done to remedy the situation. This is not a strategic 
focus, but a remedial one, and it should not distract the leadership from 
pursuing their vision. 

Goal setting for differentiators is another matter entirely. Unlike key 
requirements, the historical level of performance for differentiators is unaccep- 
table by definition. Leadership doesn’t want to maintain differentiator perfor- 
mance, it wants to improve it dramatically. Setting goals for differentiators is 
discussed next. 


Benchmarking 


Benchmarking is a topic of general interest in Six Sigma. Thus, the dis- 
cussion here goes beyond the use of benchmarking in project management 
alone. 

Benchmarking is a popular method for developing requirements and setting 
goals. In more conventional terms, benchmarking can be defined as measuring 
your performance against that of best-in-class companies, determining how 
the best-in-class achieve those performance levels, and using the information 
as the basis for your own company’s targets, strategies, and implementation. 

Benchmarking involves research into the best practices at the industry, firm, 
or process level. Benchmarking goes beyond a determination of the “industry 
standard;” it breaks the firm’s activities down to process operations and looks 
for the best-in-class for a particular operation. For example, to achieve improve- 
ment in their parts distribution process Xerox Corporation studied the retailer 
L.L. Bean. 

Benchmarking goes beyond the mere setting of goals. It focuses on practices 
that produce superior performance. Benchmarking involves setting up partner- 
ships that allow both parties to learn from one another. Competitors can also 
engage in benchmarking, providing they avoid proprietary issues. 

Benchmarking projects are like any other major project. Benchmarking must 
have a structured methodology to ensure successful completion of thorough 
and accurate investigations. However, it must be flexible to incorporate new 
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and innovative ways of assembling difficult-to-obtain information. It is a dis- 
covery process and a learning experience. It forces the organization to take an 
external view, to look beyond itself. 


THE BENCHMARKING PROCESS 


Camp (1989) lists the following steps for the benchmarking process: 
1. Planning 
1.1. Identify what is to be benchmarked 
1.2. Identify comparative companies 
1.3. Determine data collection method and collect data 
2. Analysis 
2.1. Determine current performance “gap” 
2.2. Project future performance levels 
3. Integration 
3.1. Communicate benchmark findings and gain acceptance 
3.2. Establish functional goals 
4. Action 
4.1. Develop action plans 
4.2. Implement specific actions and monitor progress 
4.3. Recalibrate benchmarks 
5. Maturity 
5.1. Leadership position attained 
5.2. Practices fully integrated into process 
The first step in benchmarking is determining what to benchmark. To focus 
the benchmarking initiative on critical issues, begin by identifying the process 
outputs most important to the customers of that process (ie. the key quality 
characteristics). This step applies to every organizational function, since each 
one has outputs and customers. The QFD/customer needs assessment is a 
natural precursor to benchmarking activities. 


GETTING STARTED WITH BENCHMARKING 


The essence of benchmarking is the acquisition of information. The process 
begins with the identification of the process that is to be benchmarked. The 
process chosen should be one that will have a major impact on the success of 
the business. 

Once the process has been identified, contact a business library and request 
a search for the information relating to your area of interest. The library will 
identify material from a variety of external sources, such as magazines, 
journals, special reports, etc. You should also conduct research using the 
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Internet and other electronic networking resources. However, be prepared to 
pare down what will probably be an extremely large list of candidates (e.g., 
an Internet search on the word “benchmarking” produced 20,000 hits). 
Don’t forget your organization’s internal resources. If your company has an 
“Intranet” use it to conduct an internal search. Set up a meeting with people 
in key departments, such as R&D. Tap the expertise of those in your company 
who routinely work with customers, competitors, suppliers, and other “out- 
side” organizations. Often your company’s board of directors will have an 
extensive network of contacts. 

The search is, of course, not random. Look for the best of the best, not the 
average firm. There are many possible sources for identifying the elites. One 
approach is to build a compendium of business awards and citations of merit 
that organizations have received in business process improvement. Sources to 
consider are Industry Week’s Best Plant’s Award, National Institute of 
Standards and Technology’s Malcolm Baldrige Award, USA Today and 
Rochester Institute of Technology's Quality Cup Award, European 
Foundation for Quality Management Award, Occupational Safety and Health 
Administration (OSHA), Federal Quality Institute, Deming Prize, 
Competitiveness Forum, Fortune magazine, United States Navy’s Best 
Manufacturing Practices, to name just a few. You may wish to subscribe to an 
“exchange service” that collects benchmarking information and makes it avail- 
able for a fee. Once enrolled, you will have access to the names of other sub- 
scribers —a great source for contacts. 

Don’t overlook your own suppliers as a source for information. If your com- 
pany has a program for recognizing top suppliers, contact these suppliers and 
see if they are willing to share their “secrets” with you. Suppliers are predis- 
posed to cooperate with their customers; it’s an automatic door-opener. Also 
contact your customers. Customers have a vested interest in helping you do a 
better job. If your quality, cost, and delivery performance improve, your cus- 
tomers will benefit. Customers may be willing to share some of their insights 
as to how their other suppliers compare with you. Again, it isn’t necessary that 
you get information about direct competitors. Which of your customer’s 
suppliers are best at billing? Order fulfillment? Customer service? Keep your 
focus at the process level and there will seldom be any issues of confidentiality. 
An advantage to identifying potential benchmarking partners through your cus- 
tomers is that you will have a referral that will make it easier for you to start 
the partnership. 

Another source for detailed information on companies is academic research. 
Companies often allow universities access to detailed information for research 
purposes. While the published research usually omits reference to the specific 
companies involved, it often provides comparisons and detailed analysis of 
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what separates the best from the others. Such information, provided by experts 
whose work is subject to rigorous peer review, will often save you thousands 
of hours of work. 

After a list of potential candidates is compiled, the next step is to choose the 
best three to five targets. A candidate that looked promising early in the process 
might be eliminated later based on the following criteria (Vaziri, 1992): 

¢ Not the best performer 

¢ Unwilling to share information and practices (i.e., doesn’t view the bench- 

marking process as a mutually beneficial learning opportunity) 

¢ Low availability and questionable reliability of information on the 

candidate 

As the benchmarking process evolves, the characteristics of the most desir- 
able candidates will be continually refined. This occurs as a result of a clearer 
understanding of your organization’s key quality characteristics and critical 
success factors and an improved knowledge of the marketplace and other 
players. 

This knowledge and the resulting actions tremendously strengthen an 
organization. 


WHY BENCHMARKING EFFORTS FAIL 
The causes of failed benchmarking projects are the same as those for other 
failed projects (DeToro, 1995): 

e Lack of sponsorship—A team should submit to management a one- to 
four-page benchmarking project proposal that describes the project, its 
objectives, and potential costs. If the team can’t gain approval for the pro- 
ject or get a sponsor, it makes little sense to proceed with a project that’s 
not understood or appreciated or that is unlikely to lead to corrective 
action when completed. 

e Wrong people on team—Who are the right people for a benchmarking 
team? Individuals involved in benchmarking should be the same ones 
who own or work in the process. It’s useless for a team to address 
problems in business areas that are unfamiliar or where the team has no 
control or influence. 

¢ Teams don’t understand their work completely—If the benchmarking 
team didn’t map, flowchart, or document its work process, and if it didn’t 
benchmark with organizations that also documented their processes, 
there can’t be an effective transfer of techniques. The intent in every 
benchmarking project is for a team to understand how its process works 
and compare it to another company’s process at a detailed level. The 
exchange of process steps is essential for improved performance. 
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e Teams take on too much—The task a team undertakes is often so broad 
that it becomes unmanageable. This broad area must be broken into smal- 
ler, more manageable projects that can be approached logically. A sug- 
gested approach is to create a functional flowchart of an entire area, such 
as production or marketing, and identify its processes. Criteria can then 
be used to select a process to be benchmarked that would best contribute 
to the organization’s objectives. 

¢ Lack of long-term management commitment—Since managers aren’t 
as familiar with specific work issues as their employees, they tend to 
underestimate the time, cost, and effort required to successfully complete 
a benchmarking project. Managers should be informed that while it’s 
impossible to know the exact time it will take for a typical benchmarking 
project, there is a rule of thumb that a team of four or five individuals 
requires a third of their time for five months to complete a project. 

¢ Focus on metrics rather than processes—Some firms focus their bench- 
marking efforts on performance targets (metrics) rather than processes. 
Knowing that a competitor has a higher return on assets doesn’t mean 
that its performance alone should become the new target (unless an under- 
standing exists about how the competitor differs in the use of its assets 
and an evaluation of its process reveals that it can be emulated or sur- 
passed). 

e Not positioning benchmarking within a larger strategy—Benchmark- 
ing is one of many Six Sigma tools—such as problem solving, process 
improvement, and process reengineering—used to shorten cycle time, 
reduce costs, and minimize variation. Benchmarking is compatible with 
and complementary to these tools, and they should be used together for 
maximum value. 

e Misunderstanding the organization’s mission, goals, and objectives— 
All benchmarking activity should be launched by management as part of 
an overall strategy to fulfill the organization’s mission and vision by first 
attaining the short-term objectives and then the long-term goals. 

e Assuming every project requires a site visit—Sufficient information is 
often available from the public domain, making a site visit unnecessary. 
This speeds the benchmarking process and lowers the cost considerably. 

¢ Failure to monitor progress—Once benchmarking has been completed 
for a specific area or process benchmarks have been established and 
process changes implemented, managers should review progress in 
implementation and results. 

The issues described here are discussed in other parts of this chapter and in 

other parts of this book. The best way of dealing with them is to prevent their 
occurrence by carefully planning and managing the project from the outset. 
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This list can be used as a checklist to evaluate project plans; if the plans don’t 
clearly preclude these problems, then the plans are not complete. 


THE BENEFITS OF BENCHMARKING 


The benefits of competitive benchmarking include: 

¢ Creating a culture that values continuous improvement to achieve excel- 
lence 

e Enhancing creativity by devaluing the not-invented-here syndrome 

e Increasing sensitivity to changes in the external environment 

e Shifting the corporate mind-set from relative complacency to a strong 
sense of urgency for ongoing improvement 

¢ Focusing resources through performance targets set with employee input 

e Prioritizing the areas that need improvement 

e Sharing the best practices between benchmarking partners 


SOME DANGERS OF BENCHMARKING 


Benchmarking is based on learning from others, rather than developing new 
and improved approaches. Since the process being studied is there for all to 
see, benchmarking cannot give a firm a sustained competitive advantage. 
Although helpful, benchmarking should never be the primary strategy for 
improvement. 

Competitive analysis is an approach to goal setting used by many firms. This 
approach is essentially benchmarking confined to one’s own industry. 
Although common, competitive analysis virtually guarantees second-rate 
quality because the firm will always be following their competition. If the entire 
industry employs the approach it will lead to stagnation for the entire industry, 
setting them up for eventual replacement by outside innovators. 
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CHAPTER 


3 


Creating Customer-Driven 
Organizations 


ELEMENTS OF CUSTOMER-DRIVEN ORGANIZATIONS 


The proper place of the customer in the organization’s hierarchy is illu- 
strated in Figure 3.1. 

Note that this perspective is precisely the opposite of the traditional view of 
the organization. The difficulties involved in making such a radical change 
should not be underestimated. 


Front-line people 
Middle management 


Figure 3.1. The “correct” view of the company organization chart. 
From Marketing Management: Analysis, Planning, Implementation, and Control, Figure 1-7, 
p. 21, by Philip Kotler, copyright © 1991 by Prentice-Hall, Inc. Reprinted by permission. 


Copyright 2003 by The McGraw-Hill Companies, Inc. Click Here for Terms of Use. 
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Becoming a customer- and market-driven 
enterprise 


Edosomwan (1993) defines a customer- and market-driven enterprise as one 
that is committed to providing excellent quality and competitive products and 
services to satisfy the needs and wants of a well-defined market segment. This 
approach is in contrast to that of the traditional organization, as shown in 
Table 3.1. 

The journey from a traditional to a customer-driven organization has been 
made by enough organizations to allow us to identify a number of distinct mile- 
stones that mark the path to success. Generally, the journey begins with recog- 
nition that a crisis is either upon the organization, or imminent. This wrenches 
the organization’s leadership out of denial and forces them to abandon the 
status quo. 

When the familiar ways of the past are no longer acceptable, the result is a 
feeling of confusion among the leaders. At this stage the leadership must answer 
some very basic questions: 

¢ What is the organization’s purpose? 

e What are our values? 

¢ What does an organization with these values look like? 

A “value” is that which one acts to gain and/or keep. It presupposes an entity 
capable of acting to achieve a goal in the face of an alternative. Values are not 
simply nice-sounding platitudes, they represent goals. Pursuing the organiza- 
tion’s values implies building an organization which embodies these values. 
This is the leadership’s vision, to create a reality where their values have been 
achieved 

After the vision has been clearly developed, the next step is to develop a 
strategy for building the new organization (see Chapter 1). The process of 
implementing the strategic plan is the turnaround stage. 


Elements of the transformed organization 


Customer-driven organizations share certain common features. 

e Flattened hierarchies—Getting everyone closer to the customer involves 
reducing the number of bureaucratic “layers” in the organization struc- 
ture. It also involves the “upside-down” perspective of the organization 
structure shown in Figure 3.1. The customer comes first, not the boss. 
Everyone serves the customer. 

e Risk-taking—Customers’ demands tend to be _ unpredictable. 
Responsiveness requires that organizations be willing to change quickly, 
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Table 3.1. Traditional organizations vs. customer-driven organizations. 
From Customer and Market-Driven Quality Management, Table 1.1, by Johnson A. 


Edosomwan, copyright © 1993 by ASQ. Reprinted by permission. 


TRADITIONAL 
ORGANIZATIONS 


CUSTOMER-DRIVEN 
ORGANIZATIONS 


Product and service 
planning 


— Short-term focus 

— Reactionary management 

— Management by objectives 
planning process 


— Long-term focus 

— Prevention-based management 

— Customer-driven strategic 
planning process 


Measures of 
performance 


— Bottom-line financial results 
— Quick return on investment 


— Customer satisfaction 
— Market share 

— Long-term profitability 
— Quality orientation 

— Total productivity 


Attitudes toward 


— Customers are irrational and 


— Voice of the customer is 


customers a pain important 
— Customers are a bottleneck — Professional treatment and 
to profitability attention to customers is 
— Hostile and careless required 
—“Take it or leave it” attitude | — Courteous and responsive 
— Empathy and respectful 
attitude 
Quality of products | — Provided according to — Provided according to 
and services organizational requirements customer requirements and 
needs 
Marketing focus — Seller’s market — Increased market share and 
— Careless about lost financial growth achieved 
customers due to poor 
customer satisfaction 
Process — Focus on error and defect — Focus on error and defect 
management detection prevention 


approach 
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Table 3.1 continued 


TRADITIONAL 
ORGANIZATIONS 


CUSTOMER-DRIVEN 
ORGANIZATIONS 


Product and service 
delivery attitude 


People orientation 


—Itis OK for customers to 
wait for products and 
services 


— People are the source of 
problems and are burdens on 
the organization 


— It is best to provide fast time- 
to market products and 
services 


— People are an organization’s 
greatest resource 


Basis for decision- 


— Product-driven 


— Customer-driven 


making — Management by opinion — Management by data 
Improvement — Crisis management — Continuous process 
strategy — Management by fear and improvement 
intimidation — Total process management 
Mode of operation — Career-driven and — Management-supported 


independent work improvement 


— Customers, suppliers, and — Teamwork between suppliers, 
process owners have nothing process owners, and customers 


in common practiced 


which involves uncertainty and risk Customer-driven organizations 
encourage risk-taking in a variety of ways. One important aspect is to 
celebrate mistakes made by individuals who engage in risky behavior. 
Bureaucratic impediments such as excessive dependence on written pro- 
cedures are minimized or eliminated. Employees are encouraged to act 
on their own best judgments and not to rely on formal approval 
mechanisms. 

Communication— During the transformation the primary task of the 
leadership team is the clear, consistent, and unambiguous transmission 
of their vision to others in the organization. One way this is done is 
through “internal marketing” which involves using the principles of mar- 
keting to get the message to the target “market”: the employees. It is vital 
that the leaders’ actions are completely consistent with their words. The 
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assistance of outside consultants may be helpful in identifying inconsis- 
tencies. 

Leaders should realize that their behavior carries tremendous symbolic 
meaning. This can contribute to the failure of convincing employees; a sin- 
gle action which is inconsistent with the stated message is sufficient to 
destroy all credibility. On the plus side, an action that clearly shows a com- 
mitment to the vision can help spread the word that “They’re serious this 
time.” The leadership should seek out stories that capture the essence of 
the new organization and repeat these stories often. For example, 
Nordstrom employees all hear the story of the sales clerk who allowed 
the customer to return a tire (Nordstrom’s doesn’t sell tires). This story 
captures the essence of the Nordstrom “rule book” which states: 


Rule #/1— Use your own best judgment. 
Rule #2—There are no other rules. 


Leaders should expect to devote a minimum of 50% of their time to commu- 

nication during the transition. 

¢ Boards of directors—lIt is vital to obtain the enthusiastic endorsement of 
the new strategy by the board. Management cannot focus their attention 
until this support has been received. This will require that management 
educate their board and ask them for their approval. However, boards 
are responsible for governance, not management. Don’t ask the board to 
approve tactics. This bogs down the board, stifles creativity in the ranks, 
and slows the organization down. 

¢ Unions—In the transformed organization, everyone’s job changes. If 
the organization’s employees are unionized, changing jobs requires 
that the union become management’s partner in the transformation 
process. In the flat organization union employees will have greater 
authority. Union representatives should be involved in all phases of 
the transformation, including planning and strategy development. By 
getting union input, the organization can be assured that during collec- 
tive bargaining the union won’t undermine the company’s ability to 
compete or sabotage the strategic plan. Unions also play a role in audit- 
ing the company’s activities to assure that they comply with contracts 
and labor laws. 

e Measuring results—It is important that the right things be measured. 
The “right things” are measurements that determine that you are deliv- 
ering on your promises to customers, investors, employees, and other 
stakeholders. You must also measure for the right reasons. This means 
that measurements are used to learn about how to improve, not for 
judgment. Finally, you must measure the right way. Measurements 
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should cover processes as well as outcomes. Data must be available 
quickly to the people who use them. Measurements must be easy to 
understand. 

Rewarding employees—Care must be taken to avoid punishing with 
rewards. Rewarding individuals with financial incentives for simply 
doing their jobs well implies that the employee wouldn’t do the job 
without the reward. It is inherently manipulative. The result is to 
destroy the very behavior you seek to encourage (Kohn, 1993). The mes- 
sage is that rewards should not be used as control mechanisms. 
Employees should be treated like adults and provided with adequate 
and fair compensation for doing their jobs. Recognizing exceptional per- 
formance or effort should be done in a way that encourages cooperation 
and team spirit, such as parties and public expressions of appreciation. 
Leaders should assure fairness: e.g., management bonuses and worker 
pay cuts don’t mix. 


SURVEYS AND FOCUS GROUPS 


There are any number of reasons why a firm may wish to communicate with 
its customers. A primary reason is the evaluation of the customer’s perception 
of the firm’s product and service quality and its impact on customer satisfaction. 
The purpose may be to get an idea of the general condition of quality and satis- 
faction, or a comparison of the current levels with the firm’s goals. A firm 
might wish to conduct employee surveys and focus groups to assess the organi- 
zation’s quality structure. 


Strategies for communicating with customers and 
employees 


There are four primary strategies commonly used to obtain information 
from or about customers and employees: 

¢ sample surveys 

* case studies 

e field experiments 

¢ available data 

With sample surveys, data are collected from a sample of a universe to 
estimate the characteristics of the universe, such as their range or dispersion, 
the frequency of occurrence of events, or the expected values of important 
universe parameters. The reader should note that these terms are consistent 
with the definition of enumerative statistical studies described in Chapter 9. 
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This is the traditional approach to such surveys. However, if survey results 
are collected at regular intervals, the results can be analyzed using the quality 
control tools described in Part II to obtain information on the underlying 
process. The process excellence leader should not be reticent in recommend- 
ing that survey budgets be allocated to conducting small, routine, periodic 
surveys rather than infrequent “big studies.” Without the information avail- 
able from time-ordered series of data, it will not be possible to learn about 
processes which produce changes in customer satisfaction or perceptions of 
quality. 

A case study is an analytic description of the properties, processes, condi- 
tions, or variable relationships of either single or multiple units under study. 
Sample surveys and case studies are usually used to answer descriptive ques- 
tions (“How do things look?”) and normative questions (“How well do things 
compare with our requirements?”’). A field experiment seeks the answer to a 
cause-and-effect question (“Did the change result in the desired outcome?”). 
Use of available data as a strategy refers to the analysis of data previously col- 
lected or available from other sources. Depending on the situation, available 
data strategies can be used to answer all three types of questions: descriptive, 
normative, and cause-and-effect. Original data collection strategies such as 
mail questionnaires are often used in sample surveys, but they may also be 
used in case studies and field experiments. 


SURVEYS 


Survey development consists of the following major tasks (GAO, 1986, p. 15): 
1. initial planning of the questionnaire 

2. developing the measures 

3. designing the sample 

4. developing and testing the questionnaire 

5. producing the questionnaire 

6. preparing and distributing mailing materials 

7. collecting data 

8. reducing the data to forms that can be analyzed 

9. analyzing the data 

Figure 3.2 shows a typical timetable for the completion of these tasks. 


GUIDELINES FOR DEVELOPING QUESTIONS 


The axiom that underlies the guidelines shown below is that the question- 
writer(s) must be thoroughly familiar with the respondent group and must 
understand the subject matter from the perspective of the respondent group. 
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LJ Plan questionnaire 


Develop constructs and measures 


Design sample 
Develop and test questionnaire 
Produce questionnaire 


Prepare mail-out package and distribute 


(¢) 1 5 6 7 8 9 
Calendar months 


Figure 3.2. Typical completion times for major questionnaire tasks. 
From Developing and Using Questionnaires, Transfer Paper 7, p. 15, Washington, DC: 
GAO Program Evaluation and Methodology Division. 


This is often problematic for the employee when the respondent group is the 
customer; methods for dealing with this situation are discussed below. There 
are eight basic guidelines for writing good questions: 
1. Ask questions in a format that is appropriate to the questions’ purpose 
and the information required. 
2. Make sure the questions are relevant, proper, and qualified as needed. 
Write clear, concise questions at the respondent’s language level. 
4. Give the respondent a chance to answer by providing a comprehensive 
list of relevant, mutually exclusive responses from which to choose. 
5. Ask unbiased questions by using appropriate formats and item construc- 
tions and by presenting all important factors in the proper sequence. 
6. Get unbiased answers by anticipating and accounting for various 
respondent tendencies. 
7. Quantify the response measures where possible. 
8. Provide a logical and unbiased line of inquiry to keep the reader’s 
attention and make the response task easier. 
The above guidelines apply to the form of the question. Using the critical 
incident technique to develop good question content is described below. 


» 
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RESPONSE TYPES 


There are several commonly used types of survey responses. 

e Open-ended questions—These are questions that allow the 
respondents to frame their own response without any restrictions 
placed on the response. The primary advantage is that such ques- 
tions are easy to form and ask using natural language, even if the 
question writer has little knowledge of the subject matter. 
Unfortunately, there are many problems with analyzing the 
answers received to this type of question. This type of question is 
most useful in determining the scope and content of the survey, 
not in producing results for analysis or process improvement. 

e Fill-in-the-blank questions—Here the respondent is provided with 
directions that specify the units in which the respondent is to answer. 
The instructions should be explicit and should specify the answer units. 
This type of question should be reserved for very specific requests, e.g., 
“What is your age on your last birthday?___ (age in years).” 

e Yes/No questions—Unfortunately, yes/no questions are very popular. 
Although they have some advantages, they have many problems and few 
uses. Yes/no questions are ideal for dichotomous variables, such as defec- 
tive or not defective. However, too often this format is used when the mea- 
sure spans a range of values and conditions, e.g., “Were you satisfied with 
the quality of your new car (yes/no)?” A yes/no response to such ques- 
tions contains little useful information. 

¢ Ranking questions—The ranking format is used to rank options accord- 
ing to some criterion, e.g., importance. Ranking formats are difficult to 
write and difficult to answer. They give very little real information and 
are very prone to errors that can invalidate all the responses. They should 
be avoided whenever possible in favor of more powerful formats and for- 
mats less prone to error, such as rating. When used, the number of ranking 
categories should not exceed five. 

e Rating questions—With this type of response, a rating is assigned on the 
basis of the score’s absolute position within a range of possible values. 
Rating scales are easy to write, easy to answer, and provide a level of quan- 
tification that is adequate for most purposes. They tend to produce reason- 
ably valid measures. Here is an example of a rating format: 


For the following statement, check the appropriate box: 
The workmanship standards provided by the purchaser are 
Clear 

Marginally adequate 

Unclear 
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¢ Guttman format—In the Guttman format, the alternatives increase in 
comprehensiveness; that is, the higher-valued alternatives include the 
lower-valued alternatives. For example, 


Regarding the benefit received from training in quality improvement: 
No benefit identified 

Identified benefit 

Measured benefit 

Assessed benefit value in dollar terms 

Performed cost/benefit analysis 


e Likert and other intensity scale formats—These formats are usually 
used to measure the strength of an attitude or an opinion. For example, 


Please check the appropriate box in response to the following statement: 
“The customer service representative was knowledgeable.” 

Strongly disagree 

Disagree 

Neutral 

Agree 

Strongly agree 


Intensity scales are very easy to construct. They are best used when 
respondents can agree or disagree with a statement. A problem is that 
statements must be worded to present a single side of an argument. We 
know that the respondent agrees, but we must infer what he believes. To 
compensate for the natural tendency of people to agree, statements are 
usually presented using the converse as well, e.g., “The customer service 
representative was not knowledgeable.” 

When using intensity scales, use an odd-numbered scale, preferably 
with five or seven categories. If there is a possibility of bias, order the 
scale in a way that favors the hypothesis you want to disprove and handi- 
caps the hypothesis you want to confirm. This way you will confirm the 
hypothesis with the bias against you—a stronger result. If there is no 
bias, put the most undesirable choices first. 

e Semantic differential format—lIn this format, the values that span the 
range of possible choices are not completely identified; only the end 
points are labeled. For example, 


Indicate the number of times you initiated communication with your custo- 
mer in the past month. 


few | | | | = many 
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The respondent must infer that the range is divided into equal intervals. 
The range seems to work well with seven categories. 

Semantic differentials are very useful when we do not have enough infor- 
mation to anchor the intervals between the poles. However, they are very 
difficult to write well and if not written well the results are ambiguous. 


SURVEY DEVELOPMENT CASE STUDY 


This actual case study involves the development of a mail survey at a commu- 
nity hospital. The same process has been successfully used by the author to develop 
customer surveys for clientele in a variety of industries. 

The study of service quality and patient satisfaction was performed at a 213 bed 
community hospital in the southwestern United States. The hospital is a non- 
profit, publicly funded institution providing services to the adult community; 
pediatric services are not provided. The purpose of the study was to: 

1. Identify the determinants of patient quality judgments. 

2. Identify internal service delivery processes that impacted patient quality 

judgments. 

3. Determine the linkage between patient quality judgments and intent-to- 
patronize the hospital in the future or to recommend the hospital to 
others. 

To conduct the study, the author worked closely with a core team of hospital 
employees, and with several ad hoc teams of hospital employees. The core team 
included the Nursing Administrator, the head of the Quality Management 
Department, and the head of Nutrition Services.** 

The team decided to develop their criteria independently. It was agreed that 
the best method of getting information was directly from the target group, in- 
patients. Due to the nature of hospital care services, focus groups were not 
deemed feasible for this study. Frequently, patients must spend a considerable 
period of time convalescing after being released from a hospital, making it 
impossible for them to participate in a focus group soon after discharge. While 
the patients are in the hospital, they are usually too sick to participate. Some 
patients have communicable diseases, which makes their participation in focus 
groups inadvisable. 

Since memories of events tend to fade quickly (Flanagan, 1954, p. 331), the team 
decided that patients should be interviewed within 72 hours of discharge. The 


“The survey referenced by this case study is located in the Appendix. 
**The nutrition services manager was very concerned that she get sufficient detail on her particular service. Thus, the critical 
incident interview instrument she used included special questions relating to food service. 
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target patient population was, therefore, all adults treated as in-patients and dis- 
charged to their homes. The following groups were not part of the study: families 
of patients who died while in the hospital, patients discharged to nursing homes, 
patients admitted for psychiatric care.* 

The team used the Critical Incident Technique (CIT) to obtain patient com- 
ments. The CIT was first used to study procedures for selection and classification 
of pilot candidates in World War II (Flanagan, 1954). A bibliography assembled 
in 1980 listed over seven hundred studies about or using the CIT (Fivars, 1980). 
Given its popularity, it is not surprising that the CIT has also been used to evaluate 
service quality. 

CIT consists of a set of specifically defined procedures for collecting observa- 
tions of human behavior in sucha way as to make them useful in addressing practi- 
cal problems. Its strength lies in carefully structured data collection and data 
classification procedures that produce detailed information not available through 
other research methods. The technique, using either direct observation or recalled 
information collected via interviews, enables researchers to gather firsthand 
patient-perspective information. This kind of self-report preserves the richness of 
detail and the authenticity of personal experience of those closest to the activity 
being studied. Researchers have concluded that the CIT produces information 
that is both reliable and valid. 

This study attempted to follow closely the five steps described by Flanagan as 
crucial to the CIT: 1) establishment of the general aim of the activity studied; 
2) development of a plan for observers or interviewers; 3) collection of data; 4) ana- 
lysis (classification) of data; and 5) interpretation of data. 


Establishment of the general aim of the activity studied 

The general aim is the purpose of the activity. In this case the activity 
involves the whole range of services provided to in-patients in the hospital. 
This includes every service activity between admission and discharge.** From 
the service provider’s perspective the general aim is to create and manage service 
delivery processes in such a way as to produce a willingness by the patient to 
utilize the provider’s services in the future. To do this the service provider 
must know which particular aspects of the service are remembered by the 
patient. 

Our general aim was to provide the service provider with information on what 
patients remembered about their hospital stay, both pleasant and unpleasant. 


This information was to be used to construct a new patient survey instrument 


*The team was unable to obtain a Spanish-speaking interviewer, which meant that some patients that were candidates were 
not able to participate in the survey. 
**Billing was not covered in the CIT phase of the study because patients had not received their bills within 72 hours. 
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that would be sent to recently discharged patients ona periodic basis. The informa- 
tion obtained would be used by the managers of the various service processes as 
feedback on their performance, from the patient’s perspective. 


Interview plan 

Interviewers were provided with a list of patients discharged within the past 3 
days. The discharge list included all patients. Non-psychiatric patients who 
were discharged to “home” were candidates for the interview. Home was defined 
as any location other than the morgue or a nursing home. Interviewers were 
instructed to read a set of predetermined statements. Patients to be called were 
selected at random from the discharge list. If a patient could not be reached, 
the interviewer would try again later in the day. One interview form was pre- 
pared per patient. To avoid bias, 50% of the interview forms asked the patient 
to recall unpleasant incidents first and 50% asked for pleasant incidents first. 
Interviewers were instructed to record the patient responses using the patient’s 
own words. 


Collection of data 

Four interviewers participated in the data collection activity, all were manage- 
ment level employees of the hospital. Three of the interviewers were female, one 
was male. The interviews were conducted when time permitted during the inter- 
viewer's normal busy work day. The interviews took place during the September 
1993 time period. Interviewers were given the instructions recommended by 
Hayes (1992, pp. 14-15) for generating critical incidents. 

A total of 36 telephone attempts were made and 23 patients were reached. Of 
those reached, three spoke only Spanish. In the case of one of the Spanish-speaking 
patients a family member was interviewed. Thus, 21 interviews were conducted, 
which is slightly greater than the 10 to 20 interviews recommended by Hayes 
(1992, p. 14). The 21 interviews produced 93 critical incidents. 


Classification of data 

The Incident Classification System required by CIT is a rigorous, carefully 
designed procedure with the end goal being to make the data useful to the problem 
at hand while sacrificing as little detail as possible (Flanagan, 1954, p. 344). There 
are three issues in doing so: 1) identification of a general framework of reference 
that will account for all incidents; 2) inductive development of major area and sub- 
area categories that will be useful in sorting the incidents; and 3) selection of the 
most appropriate level of specificity for reporting the data. 

The critical incidents were classified as follows: 

1. Each critical incident was written on a 3X5 card, using the patient’s own 

words. 
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2. The cards were thoroughly shuffled. 

3. Ten percent of the cards (10 cards) were selected at random, removed from 
the deck and set aside. 

4. Two of the four team members left the room while the other two grouped the 
remaining 83 cards and named the categories. 

5. The ten cards originally set aside were placed into the categories found in 
step 4. 

6. Finally, the two members not involved in the initial classification were told 
the names of the categories. They then took the reshuffled 93 cards and 
placed them into the previously determined categories. 

The above process produced the following dimensions of critical incidents: 
¢ Accommodations (5 critical incidents) 

* Quality of physician (14 critical incidents) 

* Care provided by staff (20 critical incidents) 
© Food (26 critical incidents) 

* Discharge process (1 critical incident) 

e Attitude of staff (16 critical incidents) 

¢ General (11 critical incidents) 


Interpretation of data 

Interjudge agreement, the percentage of critical incidents placed in the same 
category by both groups of judges, was 93.5%. This is well above the 80% cutoff 
value recommended by experts. The setting aside of a random sample and trying 
to place them in established categories is designed to test the comprehensiveness 
of the categories. If any of the withheld items were not classifiable it would be an 
indication that the categories do not adequately span the patient satisfaction 
space. However, the team experienced no problem in placing the withheld critical 
incidents into the categories. 

Ideally, a critical incident has two characteristics: 1) it is specific and 2) it 
describes the service provider in behavioral terms or the service product with speci- 
fic adjectives (Hayes, 1992, p. 13). Upon reviewing the critical incidents in the 
General category, the team determined that these items failed to have one or both 
of these characteristics. Thus, the 11 critical incidents in the General category 
were dropped. The team also decided to merge the two categories “Care provided 
by staff” and “Attitude of staff” into the single category “Quality of staff care.” 
Thus, the final result was a five dimension model of patient satisfaction judgments: 
Food, Quality of physician, Quality of staff care, Accommodations, and 
Discharge process. 

A rather obvious omission in the above list is billing. This occurred because the 
patients had not yet received their bill within the 72 hour time frame. However, 
the patient’s bill was explained to the patient prior to discharge. This item is 
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included in the Discharge process dimension. The team discussed the billing issue 
and it was determined that billing complaints do arise after the bills are sent, sug- 
gesting that billing probably is a satisfaction dimension. However, the team 
decided not to include billing as a survey dimension because 1) the time lag was so 
long that waiting until bills had been received would significantly reduce the abil- 
ity of the patient to recall the details of their stay; 2) fear that the patient’s judg- 
ments would be overwhelmed by the recent receipt of the bill; and 3) a system 
already existed for identifying patient billing issues and adjusting the billing 
process accordingly. 


Survey item development 

As stated earlier, the general aim was to provide the service provider with 
information on what patients remembered about their hospital stay, both plea- 
sant and unpleasant. This information was then to be used to construct a new 
patient survey instrument that would be sent to recently discharged patients on 
a periodic basis. The information obtained would be used by the managers of 
the various service processes as feedback on their performance, from the 
patient’s perspective. 

The core team believed that accomplishing these goals required that the man- 
agers of key service processes be actively involved in the creation of the survey 
instrument. Thus, ad hoc teams were formed to develop survey items for each of 
the dimensions determined by the critical incident study. The teams were given 
brief instruction by the author in the characteristics of good survey items. Teams 
were required to develop items that, in the opinion of the core team, met five cri- 
teria: 1) relevance to the dimension being measured; 2) concise; 3) unambiguous; 
4) one thought per item; and 5) no double negatives. Teams were also shown the 
specific patient comments that were used as the basis for the categories and 
informed that these comments could be used as the basis for developing survey 
items. 

Writing items for the questionnaire can be difficult. The process of developing 
the survey items involved an average of three meetings per dimension, with each 
meeting lasting approximately two hours. Ad hoc teams ranged in size from four 
to eleven members. The process was often quite tedious, with considerable debate 
over the precise wording of each item. 

The core team discussed the scale to be used with each ad hoc team. The core 
team’s recommended response format was a five point Likert-type scale. The con- 
sensus was to use a five point agree-disagree continuum as the response format. 
Item wording was done in such a way that agreement represented better perfor- 
mance from the hospital’s perspective. 

In addition to the response items, it was felt that patients should have an 
opportunity to respond to open-ended questions. Thus, the survey also included 
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general questions that invited patients to comment in their own words. The bene- 
fits of having such questions is well known. In addition, it was felt that these ques- 
tions might generate additional critical incidents that would be useful in 
validating the survey. 

The resulting survey instrument contained 50 items and three open-ended ques- 
tions and is included in the Appendix. 


Survey administration and pilot study 

The survey was to be tested on a small sample. It was decided to use the total 
design method (TDM) to administer the survey (Dillman, 1983). Although the 
total design method is exacting and tedious, Dillman indicated that its use would 
assure a high rate of response. Survey administration would be handled by the 
Nursing Department. 

TDM involves rather onerous administrative processing. Each survey form is 
accompanied by a cover letter, which must be hand-signed in blue ink. Follow up 
mailings are done 1, 3 and 7 weeks after the initial mailing. The 3 and 7 week follow 
ups are accompanied by another survey and another cover letter. No “bulk proces- 
sing” is allowed, such as the use of computer-generated letters or mailing labels. 
Dillman’s research emphasizes the importance of viewing the TDM as a comple- 
tely integrated approach (Dillman, 1983, p. 361). 

Because the hospital in the study is small, the author was interested in obtaining 
maximum response rates. In addition to following the TDM guidelines, he recom- 
mended that a $1 incentive be included with each survey. However, the hospital 
administrator was not convinced that the additional $1 per survey was worthwhile. 
It was finally agreed that to test the effect of the incentive on the return rate $1 
would be included in 50% of the mailings, randomly selected. 

The hospital decided to perform a pilot study of 100 patients. The patients 
selected were the first 100 patients discharged to home starting April 1, 1994. The 
return information is shown in Table 3.2. 

Although the overall return rate of 49% is excellent for normal mail-survey 
procedures, it is substantially below the 77% average and the 60% “minimum” 
reported by Dillman. As possible explanations, the author conjectures that 
there may be a large Spanish-speaking constituency for this hospital. As men- 
tioned above, the hospital is planning a Spanish version of the survey for the 
future. 

The survey respondent demographics were analyzed and compared to the 
demographics of the non-respondents to assure that the sample group was repre- 
sentative. A sophisticated statistical analysis was performed on the responses to 
evaluate the reliability and validity of each item. Items with low reliability coeff- 


cients or questionable validity were reworded or dropped. 
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Table 3.2. Pilot patient survey return information. 


A. NUMBERS 

Surveys mailed: 100 

Surveys delivered: 92 

Surveys returned as undeliverable: 8 
Survey returned, needed Spanish 
version: 1 


incentive: 55% 

Number delivered that had no $1 
incentive: 45 

Number returned that had no $1 
incentive: 19 

Percentage returned that had no $1 


incentive: 42% 
Total surveys returned: 45 
Percentage of surveys delivered 
returned: 49% 


B. SURVEY RESPONSES 

BY MAILING 

Number of surveys returned after: 
Number delivered that had $1 


incentive: 47 Initial mailing: 12 
Number returned that had $1 One week follow up: 16 
incentive: 26 Three week follow up: 8 


Percentage returned that had $1 Seven week follow up: 9 


Focus groups 


The focus group is a special type of group in terms of purpose, size, composi- 
tion, and procedures. A focus group is typically composed of seven to ten parti- 
cipants who are unfamiliar with each other. These participants are selected 
because they have certain characteristic(s) in common that relate to the topic 
of the focus group. 

The researcher creates a permissive environment in the focus group that 
nurtures different perceptions and points of view, without pressuring partici- 
pants to vote, plan, or reach consensus. The group discussion is conducted 
several times with similar types of participants to identify trends and pat- 
terns in perceptions. Careful and systematic analyses of the discussions pro- 
vide clues and insights as to how a product, service, or opportunity is 
perceived. 

A focus group can thus be defined as a carefully planned discussion 
designed to obtain perceptions on a defined area of interest in a permissive, 
non-threatening environment. The discussion is relaxed, comfortable, and 
often enjoyable for participants as they share their ideas and perceptions. 
Group members influence each other by responding to ideas and comments 
in the discussion. 

In Six Sigma, focus groups are useful in a variety of situations: 

¢ prior to starting the strategic planning process 

¢ generate information for survey questionnaires 
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¢ needs assessment, e.g., training needs 
¢ test new program ideas 

e determine customer decision criteria 
¢ recruit new customers 


FOCUS GROUP ADVANTAGES 


The focus group is a socially oriented research procedure. The advantage of 
this approach is that members stimulate one another, which may produce a 
greater number of comments than would individual interviews. If necessary, 
the researcher can probe for additional information or clarification. Focus 
groups produce results that have high face validity, i-e., the results are in the par- 
ticipant’s own words rather than in statistical jargon. The information is 
obtained at a relatively low cost, and can be obtained very quickly. 


FOCUS GROUP DISADVANTAGES 


There is less control in a group setting than with individual interviews. When 
group members interact, it is often difficult to analyze the resulting dialogue. 
The quality of focus group research is highly dependent on the qualifications 
of the interviewer. Trained and skilled interviewers are hard to find. Group-to- 
group variation can be considerable, further complicating the analysis. Finally, 
focus groups are often difficult to schedule. 


Other customer information systems 


¢ Complaint and suggestion systems typically provide all customers with an 
easy-to-use method of providing favorable or unfavorable feedback to 
management. Due to selection bias, these methods do not provide statisti- 
cally valid information. However, because they are a census rather than a 
sample, they provide opportunities for individual customers to have 
their say. These are moments of truth that can be used to increase cus- 
tomer loyalty. They also provide anecdotes that have high face validity 
and are often a source of ideas for improvement. 

¢ Customer panels are composed of a representative group of customers 
who agree to communicate their attitudes periodically via phone calls or 
mail questionnaires. These panels are more representative of the range of 
customer attitudes than customer complaint and suggestion systems. To 
be effective, the identity of customers on the panel must be withheld 
from the employees serving them. 
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e Mystery shoppers are employees who interact with the system as do real 
customers. The identity of the mystery shopperis withheld from employees. 
Once customer feedback has been obtained, it must be used to improve pro- 
cess and product quality. A system for utilizing customer feedback is shown in 
Figure 3.3. 

1. Local managers and employees serve customers’ needs on a daily basis, 
using locally modified procedures along with general corporate policies 
and procedures. 

2. By means of a standardized and locally sensitive questionnaire, deter- 
mine the needs and attitudes of customers on a regular basis. 

3. Comparing financial data, expectations, and past attitude information, 
determine strengths and weaknesses and their probable causes. 

4. Determine where and how effort should be applied to correct weak- 
nesses and preserve strengths. Repeat the process by taking action— 
step 1—and maintain it to attain a steady state or to evolve in terms of 
customer changes. 


1. TAKE ACTION 


D 


LOCAL MANAGERS 
AND 
EMPLOYEES 


2. MEASURE CUSTOMERS" 
OPINIONS 


4, PLAN CORRECTIVE OR 
INNOVATIVE ADJUSTMENT 


3. ANALYZE AND INTERPRET 
THE INFORMATION 


Cc 


COMBINE MEASURES FROM 
ALL SOURCES 


ADJUST PLANS, POLICIES, 
PRODUCTS, OR SERVICE 


ANALYZE AND INTERPRET 
THE INFORMATION 


Cc 


Figure 3.3. System for utilizing customer feedback. 
From Daltas, A.J. (1977). “Protecting service markets with consumer feedback,” 
Cornell Hotel and Restaurant Administration Quarterly, May, pp. 73-77. 
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5. A similar process can take place at higher levels, using aggregated data 
from the field and existing policy flows of the organization. 
Although this system was developed by marketing specialists, note that it 
incorporates a variation of the classical Shewhart quality improvement PDCA 
(Plan-Do-Check-Act) cycle (see Chapter 7). 


CALCULATING THE VALUE OF RETENTION OF 
CUSTOMERS 


Customers have value. This simple fact is obvious when one looks at a 
customer making a single purchase. The transaction provides revenue and 
profit to the firm. However, when the customer places a demand on the 
firm, such as a return of a previous purchase or a call for technical support, 
there is a natural tendency to see this as a loss. At these times it is impor- 
tant to understand that customer value must not be viewed on a short- 
term transaction-by-transaction basis. Customer value must be measured 
over the lifetime of the relationship. One method of calculating the lifetime 
value of a loyal customer, based on work by Frederick Reichheld of Bain 
and Co. and the University of Michigan’s Claes Fornell, is as follows 
(Stewart, 1995): 

1. Decide ona meaningful period of time over which to do the calculations. 
This will vary depending on your planning cycles and your business: A 
life insurer should track customers for decades, a disposable diaper 
maker for just a few years, for example. 

2. Calculate the profit (net cash flow) customers generate each year. 
Track several samples—some newcomers, some old-timers—to find 
out how much business they gave you each year, and how much it 
cost to serve them. If possible, segment them by age, income, sales 
channel, and so on. For the first year, be sure to subtract the cost of 
acquiring the pool of customers, such as advertising, commissions, 
back-office costs of setting up a new account. Get specific numbers— 
profit per customer in year one, year two, etc.—not averages for all 
customers or all years. Long-term customers tend to buy more, pay 
more (newcomers are often lured by discounts), and create less bad 
debt. 

3. Chart the customer “life expectancy,” using the samples to find out how 
much your customer base erodes each year. Again, specific figures are 
better than an average like “10% a year”; old customers are much less 
likely to leave than freshmen. In retail banking, 26% of account holders 
defect in the first year; in the ninth year, the rate drops to 9%. 
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4. Once you know the profit per customer per year and the customer- 
retention figures, it’s simple to calculate net present value (NPV). 
Pick a discount rate—if you want a 15% annual return on assets, use 
that. In year one, the NPV will be profit + 1.15. Next year, NPV = 
(year-two profit x retention rate) + (1.15)*. In year n, the last year in 
your figures, the NPV is the 7 year’s adjusted profit + (1.15)”. The 
sum of the years one through » is how much your customer is 
worth—the net present value of all the profits you can expect from 
his tenure. 

This is very valuable information. It can be used to find out how much to 
spend to attract new customers, and which ones. Better still, you can exploit 
the leverage customer satisfaction offers. Take your figures and calculate how 
much more customers would be worth if you increased retention by 5%. 
Figure 3.4 shows the increase in customer NPV for a 5% increase in retention 
for three industries. 

Once the lifetime value of the customer is known, it forms the basis of loy- 
alty-based management’ of the customer relationship. According to 
Reichheld (1996), loyalty-based management is the practice of carefully select- 
ing customers, employees, and investors, and then working hard to retain 
them. There is a tight, cause-and-effect connection between investor, employee 
and customer loyalty. These are the human assets of the firm. 
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Figure 3.4. Increase in customer NPV for a 5% increase in customer retention. 
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Complaint handling 

When a customer complaint has been received it represents an opportunity 
to increase customer loyalty, and a risk of losing the customer. The way the com- 
plaint is handled is crucial. The importance of complaint handling is illustrated 
in Figure 3.5. These data illustrate that the decision as to whether a customer 
who complains plans to repurchase is highly dependent on how well they felt 
their complaint was handled. Add to this the fact that customers who complain 
are likely to tell as many as 14 others of their experience, and the importance 
of complaint handling in customer relations becomes obvious. 

Despite the impressive nature of Figure 3.5, even these figures dramatically 
understate the true extent of the problem. Complaints represent people who 
were not only unhappy, they notified the company. Research indicates that up 
to 96% of unhappy customers never tell the company. This is especially unfortu- 
nate since it has been shown that customer loyalty is increased by proper resolu- 
tion of complaints. Given the dramatic impact of a lost customer, it makes 
sense to maximize the opportunity of the customer to complain. Complaints 
should be actively sought, an activity decidedly against human nature. This sug- 
gests that a system must be developed and implemented to force employees to 
seek out customer complaints. In addition to actively soliciting customer com- 
plaints, the system should also provide every conceivable way for an unhappy 
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Figure 3.5. Percent planning to repurchase vs. how complaint was handled. (*Note: The 
large durable goods survey did not include a response category of “satisfied.”’) 
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customer to contact the company on their own, including toll-free hotlines, 
email, comment cards, etc. 


KANO MODEL OF CUSTOMER EXPECTATIONS 
Customer expectations, priorities, needs, and 
“voice”’ 


Although customers seldom spark true innovation (for example, they are 
usually unaware of state-of-the art developments), their input is extremely valu- 
able. Obtaining valid customer input is a science itself. Market research firms 
use scientific methods such as critical incident analysis, focus groups, content 
analysis and surveys to identify the “voice of the customer.” Noritaki Kano 
developed the following model of the relationship between customer satisfac- 
tion and quality (Figure 3.6). 

The Kano model shows that there is a basic level of quality that customers 
assume the product will have. For example, all automobiles have windows and 
tires. If asked, customers don’t even mention the basic quality items, they take 
them for granted. However, if this quality level isn’t met the customer will be 
dissatisfied; note that the entire “Basic Quality” curve lies in the lower half of 
the chart, representing dissatisfaction. However, providing basic quality isn’t 
enough to create a satisfied customer. 
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SATISFACTION 
REGION EXPECTED 


QUALITY 


QUALITY 


DISSATISFACTION 
REGION 


BASIC 
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Figure 3.6. Kano model. 
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The “Expected Quality” line represents those expectations which customers 
explicitly consider. For example, the length of time spent waiting in line at a 
checkout counter. The model shows that customers will be dissatisfied if their 
quality expectations are not met; satisfaction increases as more expectations 
are met. 

The “Exciting Quality” curve lies entirely in the satisfaction region. This is 
the effect of innovation. Exciting quality represents unexpected quality items. 
The customer receives more than they expected. For example, Cadillac pio- 
neered a system where the headlights stay on long enough for the owner to 
walk safely to the door. When first introduced, the feature excited people. 

Competitive pressure will constantly raise customer expectations. Today’s 
exciting quality is tomorrow’s basic quality. Firms that seek to lead the mar- 
ket must innovate constantly. Conversely, firms that seek to offer standard 
quality must constantly research customer expectations to determine the 
currently accepted quality levels. It is not enough to track competitors since 
expectations are influenced by outside factors as well. For example, the 
quality revolution in manufacturing has raised expectations for service quality 
as well. 


Garden variety Six Sigma only addresses half of 
the Kano customer satisfaction model 


Some people, including your author, believe that even Six Sigma doesn’t go 
far enough. In fact, even “zero defects” falls short. Defining quality as only the 
lack of non-conforming product reflects a limited view of quality. Motorola, of 
course, never intended to define quality as merely the absence of defects. 
However, some have misinterpreted the Six Sigma program in this way. 

One problem with “garden variety” Six Sigma is that it addresses only half 
of the Kano model. By focusing on customer expectations and prevention of 
non-conformances and defects, Six Sigma addresses the portion of the Kano 
model on and below the line labeled “Expected Quality.” While there is noth- 
ing wrong with improving these aspects of business performance, it will not 
assure that the organization remains viable in the long term. Long-term suc- 
cess requires that the organization innovate. Innovation is the result of crea- 
tive activity, not analysis. Creativity is not something that can be done “by 
the numbers.” In fact, excessive attention to a rigorous process such as Six 
Sigma can detract from creative activities if not handled carefully. As dis- 
cussed above, the creative organization is one which exhibits variability, 
redundancy, quirky design, and slack. It is vital that the organization keep 
this Paradox in mind. 
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QUALITY FUNCTION DEPLOYMENT (QFD) 


Once information about customer expectations has been obtained, tech- 
niques such as quality function deployment (QFD) can be used to link the 
voice of the customer directly to internal processes. 

Tactical quality planning involves developing an approach to implementing 
the strategic quality plan. One of the most promising developments in this 
area has been policy deployment. Sheridan (1993) describes policy deployment 
as the development of a measurement-based system as a means of planning for 
continuous quality improvement throughout all levels of an organization. 
Originally developed by the Japanese, American companies also use policy 
deployment because it clearly defines the long-range direction of company 
development, as opposed to short-term. 

QED is a customer-driven process for planning products and services. It 
starts with the voice of the customer, which becomes the basis for setting 
requirements. QFD matrices, sometimes called “the house of quality,” are 
graphical displays of the result of the planning process. QFD matrices 
vary a great deal and may show such things as competitive targets and 
process priorities. The matrices are created by interdepartmental teams, 
thus overcoming some of the barriers which exist in functionally organized 
systems. 

QED is also a system for design of a product or service based on customer 
demands, a system that moves methodically from customer requirements to 
specifications for the product or service. QFD involves the entire company in 
the design and control activity. Finally, QFD provides documentation for the 
decision-making process. The QFD approach involves four distinct phases 
(King, 1987): 

Organization phase—Management selects the product or service to be 
improved, the appropriate interdepartmental team, and defines the focus 
of the QFD study. 

Descriptive phase—The team defines the product or service from several dif- 
ferent directions such as customer demands, functions, parts, reliability, 
cost, and so on. 

Breakthrough phase—The team selects areas for improvement and finds 
ways to make them better through new technology, new concepts, bet- 
ter reliability, cost reduction, etc., and monitors the bottleneck process. 

Implementation phase—The team defines the new product and how it will be 
manufactured. 

QFD is implemented through the development of a series of matrices. In its 
simplest form QFD involves a matrix that presents customer requirements as 
rows and product or service features as columns. The cell, where the row and 
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column intersect, shows the correlation between the individual customer 
requirement and the product or service requirement. This matrix is sometimes 
called the “requirement matrix.” When the requirement matrix is enhanced by 
showing the correlation of the columns with one another, the result is called 
the “house of quality.” Figure 3.7 shows one commonly used house of quality 
layout. 

The house of quality relates, in a simple graphical format, customer require- 
ments, product characteristics, and competitive analysis. It is crucial that this 
matrix be developed carefully since it becomes the basis of the entire QFD pro- 
cess. By using the QFD approach, the customer’s demands are “deployed” to 
the final process and product requirements. 

One rendition of QFD, called the Macabe approach, proceeds by developing 
a series of four related matrices (King, 1987): product planning matrix, part 
deployment matrix, process planning matrix, and production planning matrix. 
Each matrix is related to the previous matrix as shown in Figure 3.8. 

Figure 3.9 shows an example of an actual QFD matrix. 
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Figure 3.7. The house of quality. 
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Figure 3.8. QFD methodology: Macabe approach. 


Data collection and review of customer 
expectations, needs, requirements, and 


specifications 
Another approach to QED is based on work done by Yoji Akao. Akao (1990, 
pp. 7-8) presents the following 11-step plan for developing the quality plan 
and vo design, using QFD. 
First, survey both the expressed and latent quality demands of consu- 
mers in your target marketplace. Then decide what kinds of “things” 
to make. 

2. Study the other important characteristics of your target market and 
make a demanded quality function deployment chart that reflects 
both the demands and characteristics of that market. 

3. Conduct an analysis of competing products on the market, which we 
call a competitive analysis. Develop a quality plan and determine the 
selling features (sales points). 
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Figure 3.9. QFD matrix for an aerospace firm. 
From Wahl, P.R. and Bersbach, P.L. (1991), “TQM Applied—Cradle to Grave,” 
ASQ 45th Quality Congress Transactions. Reprinted with permission. 
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4. Determine the degree of importance of each demanded quality. 
5. List the quality elements and make a quality elements deployment 
chart. 
6. Make a quality chart by combining the demanded quality deployment 
chart and the quality elements deployment chart. 
7. Conduct an analysis of competing products to see how other compa- 
nies perform in relation to each of these quality elements. 
8. Analyze customer complaints. 
9. Determine the most important quality elements as indicated by custo- 
mer quality demands and complaints. 
10. Determine the specific design quality by studying the quality character- 
istics and converting them into quality elements. 
11. Determine the quality assurance method and the test methods. 


THE SIX SIGMA PROCESS ENTERPRISE 


I am often asked “Will Six Sigma work for. . .” where the blank is “health 
care,” “oil exploration,” “custom-built homes,” etc. The list is unending. My 
typical response is that, if a process is involved, Six Sigma may be able to help 
you improve it. Personally, I don’t believe that everything will benefit from the 
application of Six Sigma rigor. There are some things that aren’t processes, 
such as pure creativity, love and unstructured play. I don’t believe a chess grand- 
master would benefit from the advice of a Black Belt applying DMAIC to his 
moves, nor would his equivalent in the R&D area. There are other things that 
are processes, but processes so poorly understood that we don’t know enough 
about them to use the Six Sigma approach to improve them, such as pure 
research, social relationships, criminal behavior, or curing substance abuse. 
However, the vast majority of processes encountered in business, non-profit 
organizations, and government services fall into the category of processes that 
can be improved by the application of Six Sigma methods. 

But what exactly is a “process”? There is a tendency to narrowly interpret the 
term process to refer to a manufacturing operation that converts raw materials 
into finished products. That’s true, of course. But as I use the term process 
throughout this book it has a much broader meaning. In this book process refers 
to any activity or set of activities that transform inputs to create values for stake- 
holders. The inputs can be labor, expertise, raw materials, products, transac- 
tions, or services that someone is willing to pay more for than they cost to 
create. In other words, the process adds value to the inputs. Said another way, 
the process is the act of creating value. The value can be a cured disease, a tasty 
banana split, a great movie, a successfully completed credit card transaction, 
or acold soda purchased at a convenience store. 
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Reengineering, the process redesign fad so popular in the early 1990s, has 
become associated in the minds of many with brutal downsizing. Many aca- 
demics condemned it as heartless and cold. But the problem wasn’t caused 
by reengineering. Reengineering (and Six Sigma) focus attention on broken 
and inefficient processes. The truth is, this focus enabled companies to oper- 
ate faster and more efficiently and to use information technology more pro- 
ductively. It gave employees more authority and a clearer view of how their 
work fit into the broader scheme of things. Customers benefited from lower 
prices, higher quality and better services, and investors enjoyed a higher rate 
of return. And, more germane to our discussion of processes, reengineering 
taught business leaders to see their organizations not as control structures, 
but as processes that deliver value to customers in a way that creates profits 
for shareholders. 


Examples of processes 


Many business leaders think of their organizations as extremely complex. 
From a process perspective, this is seldom the case, at least at the high levels. 
For example, Texas Instruments was able to break its $4 billion semiconductor 
business into six core processes: 

1. Strategy development. 

Product development. 

Customer design and support. 
Manufacturing capability development. 
Customer communication. 

. Order fulfillment. 

A large financial software company described its four core processes in plain 
English as: 

1. Provide good products at good prices. 

2. Acquire customers and maintain good relations with them. 

3. Make it easy to buy from us. 

4. Provide excellent service and support after the sale. 

Both of these companies have thousands of employees and generate billions 
of dollars in sales. Yet what they do for customers is really very simple. Once 
the basic (core) processes have been identified, the relationship between them 
should be determined and drawn on a process map. (Process mapping is dis- 
cussed in greater detail in Part II of this handbook.) The process map presents 
employees with a simple picture that illustrates how the enterprise serves its 
customers. It is the basis for identifying subprocesses and, eventually, Six 
Sigma projects. Table 3.3 gives some examples of high-level processes and sub- 
processes. 


AUR 
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Table 3.3. Examples of high-level processes and subprocesses. 


Core Process Subprocess 


Product development *R&D 
© Design creation 
¢ Prototype development 
¢ Design production support 


Marketing ¢ Inspiration, concept discovery 
¢ Customer identification 
¢ Developing market strategies 
© Concept production support 
© Customer acquisition and maintenance 


Product creation e Manufacturing 
¢ Procurement 
e Installation 


Sales and service ¢ Fulfillment (order ® payment) 
© Pre-sale customer support 
® Installation and front-line service 
* Usage 


Meta-processes * Process excellence (Six Sigma) 
© Voice of customer 
¢ Voice of shareholder 


© Voice of employee 


The truth is, it’s the organizational structure that’s complicated, not the 
business itself. The belief that the business is complicated results from a mis- 
placed internal perspective by its leaders and employees. In a traditional 
organization tremendous effort is wasted trying to understand what needs 
to be done when goals are not well defined and people don’t know how 
their work relates to the organization’s purpose. A process focus is often 
the first real “focus” an employee experiences, other than pleasing one’s 
superiors. 
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The source of conflict 
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Management structures, since the time of Alfred P. Sloan in the 1920s and 
1930s, are designed to divide work into discrete units with clear lines of respon- 
sibility and authority. While this approach produced excellent results for a 
time, it has inherent flaws that became quite apparent by 1980. Organizations 
put leadership atop a pyramid-shaped control system designed to carry out 
their strategies. Control of the resources needed to accomplish this resided in 
the vertical pillars, known as “functions” or “divisions.” This command-and- 
control approach is depicted in Figure 3.10. 

This arrangement creates “turf” where, much like caste systems, activities 
within a given area are the exclusive domain of that area. Personnel in engineer- 
ing, for example, are not allowed to engage in activities reserved to the finance 
group, nor is finance allowed to “meddle” in engineering activities. These turfs 
are jealously guarded. In such a structure employees look to the leadership to 
tell them what to do and to obtain the resources needed to do it. This upward- 
inward focus is the antithesis of an external-customer focus. As Figure 3.10 also 
shows, customer value is created by processes that draw resources from several 
different parts of the organization and end at acustomer contact point. If an orga- 
nization wants to be customer-focused, then it must change the traditional struc- 
ture so its employees look across the organization at processes. As you might 
expect, this calls for a radical rethinking of the way the enterprise operates. 

As long as control of resources and turf remain entirely with the functional 
units, the enterprise will remain focused inwardly. Goals will be unit-based, 
rather than process-based. In short, Six Sigma (or any other process-oriented 
initiative) will not work. Functional department leaders have both the incentive 
and the ability to thwart cross-functional process improvement efforts. This 
doesn’t mean that these people are “bad.” It’s simply that their missions are 


Senior Leaders 
Develop Strategies 
Allocate Resources 


[ [ I at a Baad, ae: 
Engineering Leader Finance Leader Marketing Ete. for other functions | 
Engr activities Financial control systems Control customer contact | 


Deploy engr strategy Deploy finance strategy Deploy marketing strategy 
Control engr resources Control finance resources Control marketing resources H 


‘Sorsoqes 


Engr activity #1 Finance activity #1 Marketing activity #1 Other activity #1 


Engr activity #2 Finance activity #2 Marketing activity #2 Other activity #2 


etc 


Customer value processes 


Figure 3.10. Traditional command-and-control organizational structure. 
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defined in such a way that they are faced with a dilemma: pursue the mission 
assigned to my area to the best of my ability, or support an initiative that 
detracts from it but benefits the enterprise as a whole. Social scientists call this 
“the tragedy of the commons.” It is in the best interest of all fishermen not to 
overharvest the fishing grounds, but it is in the interest of each individual fisher- 
man to get all he can from this “common resource.” Similarly, it is in the best 
interest of the enterprise as a whole to focus on customers, but it is in each func- 
tional leader’s best interest to pursue his or her provincial self-interest. After 
all, if every other functional manager tries to maximize the resources devoted 
to their area and I don’t, I’ll lose my department’s share of the resources. Self- 
interest wins hands down. 


A resolution to the conflict 


Some companies—such as IBM, Texas Instruments, Owens Corning, and 
Duke Power—have successfully made the transition from the traditional organi- 
zational structure to an alternative system called the “Process Enterprise” 
(Hammer and Stanton, 1999). In these companies the primary organizational 
unit is not the functional department, but the process development team. These 
cross-functional teams, like the reengineering teams of old, have full responsibil- 
ity for a major business process. For example, a product development team 
would work together in the same location to build the product development pro- 
cess from concept to launch. They would produce the design, documentation, 
training materials, advertising, etc. Ina Process Enterprise authority and control 
of resources is redistributed in a manner that achieves a balance of power 
between the process-focused and structure-focused aspects of the enterprise. 

The differences between Process Enterprises and traditional organizations are 
fundamental. In the Process Enterprise a new position is created, that of Process 
Owner or Business Process Executive (BPE). The BPE position is permanent. 
BPEs are assigned from the senior-most executive body and given responsibility 
for designing and deploying the process, as well as control over all expenditures 
and supporting technology. They establish performance metrics, set and distri- 
bute budgets, and train the front-line workers who perform the process work. 
However, the people who perform the process work report to unit heads, not 
BPEs. In the Process Enterprise process goals are emphasized over unit goals. 
Process performance is used as a basis for compensation and advancement. 


A NEW WAY TO MANAGE 


In a Process Enterprise lines of authority are less well defined. BPEs and 
functional unit managers are expected to work together to resolve disagree- 
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ments. The BPE doesn’t exert direct control over the workers, but because he 
controls budgets and sets goals by which unit managers will be evaluated, he 
does have a good deal of influence. The unit managers have to see to it that the 
process designs are sound, the resource allocation sufficient, and the goals 
clear and fair. In short, managing in a Process Enterprise places a premium on 
collaboration and cooperation. 

One tool that has been developed to help clarify the different roles and 
responsibilities is the Decision Rights Matrix (Hammer and Stanton, 1999, 
p. 113). This matrix specifies the roles the different managers play for each 
major decision, such as process changes, personnel hiring, setting budgets, and 
so on. For example, on a given decision must a given manager: 

¢ Make the decision? 

¢ Be notified in advance? 

¢ Beconsulted beforehand? 

¢ Be informed after the fact? 

The Decision Rights Matrix serves as a roadmap for the management team, 
especially in the early stages of the transition from traditional organization 
to Process Enterprise. Eventually team members will internalize the matrix 
rules. 

BPEs must also work together. Processes overlap and process handoffs are 
critical. Often the same worker works with different processes. To avoid “hori- 
zontal turf wars” senior leadership needs to set enterprise goals and develop 
compensation and incentive systems that promote teamwork and cooperation 
between process owners. 


Process excellence 


The need for interprocess cooperation highlights the fact that no process is 
an island. From the customer’s perspective, it’s all one process. Overall excel- 
lence requires that the entire business be viewed as the customer sees it. One 
way to accomplish this is to set up a separate process with a focus of overall 
process excellence. For the sake of discussion, let’s call this Process 
Excellence (PEX). PEX will have a BPE and it will be considered another 
core business process. The mission of PEX is to see to it that all business pro- 
cesses accomplish the enterprise goals as they relate to customers, share- 
holders, and employees. PEX is also concerned with helping BPEs improve 
their processes, both internally and across the process boundaries. In other 
words, PEX is a meta-process, a process of processes. BPEs, unit managers, 
and Process Excellence leaders work together through Process Excellence 
Leadership Teams (PELTs) to assure that the needs of the major stakeholder 
groups are met (Figure 3.11). 
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PELTs /PEX 
60, collaborate, negotiate, communicate, feedback, 
teamwork 
Process Owners Unit Managers 
¢ Manage processes ° Manage people 
¢ Design processes * Operate processes 
Strategies dy aes i of eeeaneeal Happy 
pias et process goals et unit goals aa ners 
* Metrics ¢ Measure process ¢ Measure process *Shareholders 
* Goals results (Ys) drivers (Xs) “Employees 
¢ Train, inspire * Coach front line 
front line workers workers 
* Control budgets ¢ Utilize resources 


Figure 3.11. Process Enterprise roles and responsibilities. 


SIX SIGMA AND THE PROCESS ENTERPRISE 


Once the decision is made to become a Six Sigma Process Enterprise, the 
question of how to integrate the Six Sigma infrastructure will arise. Here are 
my recommendations: 

1. Designate Process Excellence (PEX) as one of the enterprise’s core 

processes and select a BPE. 

2. Master Black Belts will report to PEX. The Master Black Belts will have 
an enterprise-wide perspective. They will be concerned with the internal 
processes in PEX, as well as the overall value creation and delivery 
produced by the cooperative efforts of the core processes. 

3. Black Belts will report to the BPEs, but the budget for the Black Belts 
comes from Process Excellence. This gives PEX influence which helps 
maintain the enterprise perspective, but leaves day-to-day management 
and control with the Black Belt’s customers, the BPEs. 

4. BPEs have PEX goals, tied to incentives. PEX incentives are in the PEX 
budget. 

5. Unit managers have process-based incentives. Process incentives are in 


the BPE’s budgets. 
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6. The PEX leader and BPEs should collaboratively create a Decision 

Rights Matrix identifying: 

¢ The roles and responsibilities of PEX, BPEs, and unit managers. For 
example, hiring, budgets, project selection. 

¢ Who makes the decision in the areas just described? 

¢ Who must be consulted in decision-making? 

e What is the communication plan? 

7. PEX helps develop a BPE Coordination Plan addressing such interpro- 
cess issues as: 

e Where do the core processes overlap? 

¢ How will cross-process Six Sigma projects be chartered and coordi- 
nated? 

¢ Who will assure that overlapping activities and handoffs are coordi- 
nated? (PEX plays a facilitation role here.) 

e When is standardization across processes best and when isn’t it? The 
process intersections should be invisible to customers (e.g., custo- 
mers shouldn’t have to provide the same information more than 
once; single form information for ordering of products, support 
plans, registration, etc.). However, diversity may be necessary to 
serve unique customer needs. 


You may have noticed that having Black Belts reporting to BPEs instead of to 
PEX seems to contradict the advice given in the first chapter where I strongly 
recommended having the Black Belts report centrally. However, there is a criti- 
cal difference. The traditional organizational structure was assumed in 
Chapter 1, so if the Black Belts didn’t report to the Six Sigma organization 
(referred to here as PEX) they would have been reporting to the unit managers. 
I am not recommending that they report to unit managers, but to BPEs. BPEs 
are process owners, which gives them a much different perspective than the 
unit manager. This perspective, unlike that of unit managers, meshes very well 
with the Six Sigma focus on process improvement. 


USING QFD TO LINK SIX SIGMA PROJECTS TO 
STRATEGIES 


A common problem with Six Sigma is that there is a cognitive disconnect 
between the Six Sigma projects and top leadership’s strategic goals. In the pre- 
vious chapter we discussed the development of Strategy Deployment Plans. 
Strategy Deployment Plans are simple maps showing the linkage between stake- 
holder satisfaction, strategies, and metrics. However, these maps are inadequate 
guides to operational personnel trying to relate their activities to the vision of 
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their leadership. Unfortunately, more complexity is required to communicate 
the strategic message throughout the organization. We will use QFD for this 
purpose. An example, based on the Strategy Deployment Plan shown in 
Chapter 2 (Figure 2.4, page 72), will illustrate the process. 


The strategy deployment matrix 

The first QFD matrix will be based directly on the Strategy Deployment 
Plan. If you take a more detailed look at the Strategy Deployment Plan you'll 
notice that the situation is oversimplified. For example, the strategy for opera- 
tional excellence is related to operations and logistics, but the Strategy 
Deployment Plan doesn’t show this (except indirectly through the link between 
internal process excellence and customer perceived value). A Six Sigma project 
addressing inventory levels would have an impact on both strategies, but it 
wouldn’t be possible to measure the impact from the Strategy Deployment 
Plan alone. QFD will help us make this evaluation explicit. A completed Phase 
I Strategy Deployment Matrix is shown in Figure 3.12. 

The process for developing the Strategy Deployment Matrix is: 

1. Create a matrix of the strategies and metrics. 

2. Determine the strength of the relationship between each strategy and 

metric. 

3. Calculate a weight indicating the relative importance of the metric. 

To begin we create a matrix where the rows are the strategies (what we want 
to accomplish) and the columns are the dashboard metrics (how we will opera- 
tionalize the strategies and monitor progress). Note that this is the typical 
what-how QFD matrix layout, just with a different spin. In each cell (intersec- 
tion of arow anda column) we will place a symbol assigning a weight to the rela- 
tionship between the row and the column. The weights and symbols used are 
shown in Figure 3.13. 

The weights are somewhat arbitrary and you can choose others if you desire. 
These particular values increase more-or-less exponentially, which places a 
high emphasis on strong relationships, the idea being that we are looking for 
clear priorities. Weights of 1-2-3 would treat the different relationship strengths 
as increasing linearly. Choose the weighting scheme you feel best fits your 
strategy. 

After the relationships have been determined for each cell, we are ready to 
calculate scores for each row. Remember, the rows represent strategies. For 
example, the first row represents our productivity strategy. The Strategy 
Deployment Plan indicated that the productivity strategy was operationalized 
by the metrics cost-per-unit and asset utilization, and a strong relationship (©) 
is shown between these metrics and the productivity strategy. However, QFD 
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Figure 3.12. Strategy Deployment Matrix. 


Chart produced using QFD Designer software. Qualsoft, LLC. www.qualisoft.com. 


analysis also shows a strong relationship between this strategy and inventory 
turns, which affects asset utilization. Critical to quality (CTQ) and profit per 
customer are somewhat related to this strategy. To get an overall score for the 
productivity strategy just sum the weights across the first row; the answer is 
29. These row (strategy) weights provide information on how well the dash- 
boards measure the strategies. A zero would indicate that the strategy isn’t mea- 
sured at all. However, a relatively low score doesn’t necessarily indicate a 
problem. For example, the regulatory compliance strategy has a score of 9, but 
that comes from a strong relationship between the regulatory compliance 
audit and the strategy. Since the audit covers all major compliance issues, it’s 
entirely possible that this single metric is sufficient. 

The columns represent the metrics on the top-level dashboard, although only 
the differentiator metrics will be monitored on an ongoing basis. The metric’s 
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Relationship 

Description Weight | Symbol 
Strong relationship 9 © 
Moderate relationship 3 O 
Some relationship 1 A 
Differentiator metric 5 ® 
Key requirement metric 1 J 


target is shown at the bottom of each column in the “how” portion of the 
matrix. Setting these targets is discussed in Chapter 2. QFD will provide a rea- 
lity check on the targets. As you will see, QFD will link the targets to specific 
Six Sigma activities designed to achieve them. At the project phase it is far easier 
to estimate the impact the projects will have on the metric. If the sum of the pro- 
ject impacts isn’t enough to reach the target, either more effort is needed or the 
target must be revised. Don’t forget, there’s more to achieving goals than Six 
Sigma. Don’t hesitate to use QFD to link the organization’s other activities to 
the goals. 

As discussed in the previous chapter, leadership’s vision for the hypothetical 
company is that they be the supplier of choice for customers who want state-of- 
the-art products customized to their demanding requirements. To achieve this 
vision they will focus their strategy on four key differentiators: new product 
introductions, revenue from new sources, intimate customer relationship, and 
R&D deployment time. With our chosen weighting scheme differentiator col- 
umns have a strategic importance score of 5, indicated with a @ symbol in the 
row labeled Strategic Importance Score. These are the metrics that leadership 
will focus on throughout the year, and the goals for them are set very high. 
Other metrics must meet less demanding standards and will be brought to the 
attention of leadership only on an exception basis. The row labeled Relative 
Metric Weight is the product of the criteria score times the strategic importance 
score as a percentage for each column. The four differentiator metrics have the 
highest relative scores, while product selection (i.e., having a wide variety of stan- 
dard products for the customer to choose from) is the lowest. 
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It is vital when using QFD to focus on only the most important columns! 


Columns identified with a ® in the row labeled Strategic Importance Score 
are not part of the organization’s differentiation strategy. This isn’t to say that 
they are unimportant. What it does mean is that targets for these metrics will 
probably be set at or near their historical levels as indicated by process behavior 
charts. The goals will be to maintain these metrics, rather than to drive them to 
new heights. An organization has only limited resources to devote to change, 
and these resources must be focused if they are to make a difference that will 
be noticed by customers and shareholders. This organization’s complete dash- 
board has twenty metrics, which can hardly be considered a “focus.” By limiting 
attention to the four differentiators, the organization can pursue the strategy 
that their leadership believes will make them stand out in the marketplace for 
customer and shareholder dollars.* 


Deploying differentiators to operations 


QFD most often fails because the matrices grow until the analysis becomes 
burdensome. As the matrix grows like Topsy and becomes unwieldy, the team 
performing QFD begins to sense the lack of focus being documented by the 
QFD matrix. Soon, interest begins to wane and eventually the effort grinds to 
a halt. This too, is avoided by eliminating key requirements from the strategy 
deployment matrix. We will create a second-level matrix linked only to the dif- 
ferentiators. This matrix relates the differentiator dashboard metrics to depart- 
mental support strategies and it is shown in Figure 3.14. 

To keep things simple, we only show the strategy linkage for three depart- 
ments: engineering, manufacturing, and marketing; each department can pre- 
pare its own QFD matrix. Notice that the four differentiator metric columns 
now appear as rows in the matrix shown in Figure 3.14. These are the QFD 
“whats.” The software automatically brings over the criteria performance tar- 
get, criteria scores, and relative criteria scores for each row. This information is 
used to evaluate the strategy support plans for the three departments. 

The support plans for the three departments are shown as columns, the QFD 
“hows,” or how these three departments plan to implement the strategies. The 
relationship between the whats and hows is determined as described above. 
For each column the sum of the relationship times the row criteria score is cal- 
culated and shown in the score row near the bottom of the chart. This informa- 


*The key requirements probably won’t require explicit support plans. However, if they do QFD can be used to evaluate the 
plans. Key requirements QFD should be handled separately. 
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Figure 3.14. Phase II matrix: differentiators. 
Chart produced using QFD Designer software. Qualsoft, LLC. www.qualisoft.com. 


tion will be used to select and prioritize Six Sigma projects in the next phase of 
the QFD. 

Figure 3.14 also has a roof, which shows correlations between the whats. This 
is useful in identifying related Six Sigma projects, either within the same depart- 
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ment or in different departments. For example, there is a strong relationship 
between the two engineering activities: faster prototype development and 
improve concept-to-design cycle time. Perhaps faster prototype development 
should be a subproject under the broad heading of improve concept-to-design 
cycle time. This also suggests that “improve concept-to-design cycle time” may 
have too large a scope. The marketing strategy of “improve ability to respond 
to changing customer needs” is correlated with three projects in engineering 
and manufacturing. When a strategy support plan involves many cross-func- 
tional projects it may indicate the existence of a core process. This suggests a 
need for high-level sponsorship, or the designation of a process owner to coordi- 
nate projects. 


Deploying operations plans to projects 


Figure 3.15 isa QFD matrix that links the department plans to Six Sigma pro- 
jects. (In reality this may require additional flow down steps, but the number 
of steps should be kept as small as possible.) The rows are the department 
plans. The software also carried over the numeric relative score from the bottom 
row of the previous matrix, which is a measure of the relative impact of the 
department plan on the overall differentiator strategy. The far right column, 
labeled “Goal Score” is the sum of the relationships for the row. For this exam- 
ple only the top five department plans are deployed to Six Sigma projects. By 
summing the numeric relative scores we can determine that these five plans 
account for 86% of the impact. In reality you will also only capture the biggest 
hitters, although there’s nothing magic about the number five. 

There are three Black Belts shown, and eight projects. Each project is shown 
as a column in the matrix. The relationship between the project and each depart- 
mental plan is shown in the matrix. The bottom row shows the “Project 
Impact Score,” which is the sum of the relationships for the project’s column 
times the row’s numeric relative score. 


INTERPRETATION 


Since the numeric relative scores are linked to department plans, which are 
linked to differentiator metrics, which are linked to strategies, the project 
impact score measures the project’s impact on the strategy. The validity of 
these “carry-over scores” has been questioned (Burke et al., 2002). Through the 
Strategy Deployment Plan we can trace the need for the project all the way 
back to stakeholders (Figure 3.16). This logical thread provides those engaged 
in Six Sigma projects with an anchor to reality and the meaning behind their 
activities. 
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Figure 3.15. Phase II matrix: Six Sigma projects. 
Chart produced using QFD Designer software. Qualsoft, LLC. www.qualisoft.com. 


The Goal Score column can also be used to determine the support Six Sigma 
provides for each department plan. Note that the marketing plan to “Identify 
target markets for new products” isn’t receiving any support at all from Six 
Sigma projects (assuming that these eight projects are all of the Six Sigma pro- 
jects). This may be okay, or it may not be. It all depends on how important the 
plan is to the strategic objectives, and what other activities are being pursued 
to implement the plan. The Executive Six Sigma Council may wish to examine 
project QFD matrices to determine if action is necessary to reallocate Six 
Sigma resources. 

The Project Impact Score row is useful in much the same way. This row can 
be rank-ordered to see which projects have the greatest impact on the strategy. 
It is also useful in identifying irrelevant projects. The project Mike L is pursuing 
to improve “Pin manufacturing capability” has no impact on any of the depart- 


Department Differentiator Stakeholder 
Plan Metric Satisfaction 


Figure 3.16. Linkage between Six Sigma projects and stakeholders. 
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mental plans. Unless it impacts some other strategy support plan that isn’t 
shown in the QFD matrix, it should be abandoned as a Six Sigma project. The 
project may still be something the manufacturing department wants to pursue, 
perhaps to meet a goal for a key requirement. However, as a general rule Six 
Sigma projects requiring a Black Belt should focus on plans that have a direct 
linkage to differentiator strategies. 


LINKING CUSTOMER DEMANDS TO BUDGETS 


Once customers have made their demands known, it isimportant that these be 
translated into internal requirements and specifications. The term “translation” 
is used to describe this process because the activity literally involves interpreting 
the words in one language (the customer’s) into those of another (the employee). 
For example, regarding the door of her automobile the customer might say “TI 
want the door to close completely when I push it, but I don’t want it swinging 
closed from just the wind.” The engineer working with this requirement must 
convert it into engineering terminology such as pounds of force required to 
move the door from an open to a closed position, the angle of the door when it’s 
opened, and so on. Care must be taken to maintain the customer’s intent 
throughout the development of internal requirements. The purpose of specifica- 
tions is to transmit the voice of the customer throughout the organization. 

In addition to the issue of maintaining the voice of the customer, there is the 
related issue of the importance assigned to each demand by the customer. 
Design of products and services always involves tradeoffs: gasoline economy 
suffers as vehicle weight increases, but safety improves as weight increases. 
The importance of each criterion must be determined by the customer. When 
different customers assign different importance to criteria, design decisions 
are further complicated. 

It becomes difficult to choose from competing designs in the face of ambigu- 
ity and customer-to-customer variation. Add to this the differences between 
internal personnel and objectives—department vs. department, designer vs. 
designer, cost vs. quality, etc-—— and the problem of choosing a design alter- 
native quickly becomes complex. A rigorous process for deciding which 
alternative to settle on is helpful in dealing with the complexity. 


Structured decision-making* 


The first step in deciding upon a course of action is to identify the goal. For 
example, let’s say you’re the owner of the Product Development process for a 


* Use of this approach in designing for six sigma is discussed in Chapter 19. 
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company that sells software to help individuals manage their personal finances. 
The product, let’s call it DollarWise, is dominant in its market and your com- 
pany is well respected by its customers and competitors, in large part because 
of this product’s reputation. The business is profitable and the leadership 
naturally wants to maintain this pleasant set of circumstances and to build 
on it for the future. The organization has committed itself to a strategy of 
keeping DollarWise the leader in its market segment so it can capitalize on 
its reputation by launching additional new products directed towards other 
financially oriented customer groups, such as small businesses. They have 
determined that Product Development is a core process for deploying this 
strategy. 

As the process owner, or Business Process Executive, you have control of the 
budget for product development, including the resources to upgrade the exist- 
ing product. Although it is still considered the best personal financial software 
available, DollarWise is getting a little long in the tooth and the competition 
has steadily closed the technical gap. You believe that a major product upgrade 
is necessary and want to focus your resources on those things that matter most 
to customers. Thus, your goal is: 


GOAL: Determine where to focus product upgrade resources 


Through a variety of “listening posts” (focus groups, user laboratories, inter- 
net forums, trade show interviews, conference hospitality suites, surveys, let- 
ters, technical support feedback, etc.), you have determined that customers ask 
questions and make comments like the following: 

¢ Can I link a DollarWise total to a report in my word processor? 

¢ Ihave a high speed connection and I'd like to be able to download big data- 

bases of stock information to analyze with DollarWise. 

e [like shortcut keys so I don’t have to always click around in menus. 

e Tonly have a 56K connection and DollarWise is slow on it. 

¢ [use the Internet to pay bills through my bank. I’d like to do this using 

DollarWise instead of going to my bank’s web site. 

e [want an interactive tutorial to help me get started. 

¢ [want printed documentation. 

¢ I want the installation to be simple. 

e [want the user interface to be intuitive. 

¢ I want to be able to download and reconcile my bank statements. 

¢ I want to be able to upgrade over the Internet. 

e [want to manage my stock portfolio and track my ROI. 

e [dlike to have the reports I run every month saved and easy to update. 

e It’s a pain to set up the different drill downs every time I want to analyze 

my spending. 
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It’s clunky to transfer information between DollarWise and Excel. 

When I have a minor problem, I’d like to have easy-to-use self-help avail- 
able on the Internet or in the help file. 

When it’s a problem I can’t solve myself, I want reasonably priced, easy to 
reach technical support. 

You should be making patches and bug-fixes available free on the Internet. 


The first step in using this laundry list of comments is to see if there’s an 
underlying structure embedded in them. If these many comments address only 
a few issues, it will simplify the understanding of what the customer actually 
wants from the product. While there are statistical tools to help accomplish 
this task (e.g., structural equation modeling, principal components analysis, fac- 
tor analysis), they are quite advanced and require that substantial data be col- 
lected using well-designed survey instruments. An alternative is to create an 
“affinity diagram,” which is a simple procedure described elsewhere in this 
text (see page 314). After creating the affinity diagram, the following structure 
was identified: 


1. 


Easy to learn. 

1.1. I want the installation to be simple. 

1.2. I want an interactive tutorial to help me get started. 

1.3. I want printed documentation. 

1.4. I want the user interface to be intuitive. 

Easy to use quickly after I’ve learned it well. 

2.1. Ilike shortcut keys so I don’t have to always click around in menus. 

2.2. Td like to have the reports I run every month saved and easy to 
update. 

2.3. It’s a pain to set up the different drill downs every time I want to 
analyze my spending. 

Internet connectivity. 

3.1. I use the Internet to pay bills through my bank. Id like to do this 
using DollarWise instead of going to my bank’s web site. 

3.2. Tonly have a 56K connection and Dollar Wise is slow on it. 

3.3. Ihave a high speed connection and Id like to be able to download 
big databases of stock information to analyze with DollarWise. 

3.4.. I want to be able to download and reconcile my bank statements. 

3.5. I want to manage my stock portfolio and track my ROI. 

Works well with other software I own. 

4.1. It’s clunky to transfer information between DollarWise and 
Excel. 

4.2. Can] link a DollarWise total to a report in my word processor? 

Easy to maintain 

5.1. I want to be able to upgrade over the Internet. 
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5.2. You should be making patches and bug-fixes available free on the 
Internet. 

5.3. When Ihave a minor problem, I'd like to have easy-to-use self-help 
available on the Internet or in the help file. 

5.4. When it’s a problem I can’t solve myself, I want reasonably priced, 
easy to reach technical support. 


The reduced model shows that five key factors are operationalized by the 
many different customer comments (Figure 3.17). 

Next, we must determine importance placed on each item by customers. 
There are a number of ways to do this. 


Have customers assign importance weights using a numerical scale (e.g, 
“How important is “Easy self-help’ on a scale between 1 and 10?”). 

Have customers assign importance using a subjective scale (e.g., unimpor- 
tant, important, very important, etc.). 

Have customers “spend” $100 by allocating it among the various items. In 
these cases it is generally easier for the customer to first allocate the $100 
to the major categories, then allocate another $100 to items within each 
category. 

Have customers evaluate a set of hypothetical product offerings and indi- 
cate their preference for each product by ranking the offerings, assigning 
a “likely to buy” rating, etc. The product offerings include a carefully 
selected mix of items chosen from the list of customer demands. The list 
is selected in such a way that the relative value the customer places on 
each item in the offering can be determined from the preference values. 
This is known as conjoint analysis, an advanced technique that is covered 
in most texts on marketing statistics. 

Have customers evaluate the items in pairs, assigning a preference rating 
to one of the items in each pair, or deciding that both items in a pair 
are equally important. This is less tedious if the major categories are 
evaluated first, then the items within each category. The evaluation can 
use either numeric values or descriptive labels that are converted to 
numeric values. The pairwise comparisons can be analyzed to derive 
item weights using a method known as the Analytic Hierarchical 
Process (AHP) to determine the relative importance assigned to all of 
the items. 


All of the above methods have their advantages and disadvantages. The sim- 
ple methods are easy to use but less powerful (ie., the assigned weights are less 
likely to reflect actual weights). The more advanced conjoint and AHP methods 
require special skills to analyze and interpret properly. We will illustrate the 
use of AHP for our hypothetical software product. AHP is a powerful tech- 
nique that has been proven in a wide variety of applications. In addition to its 
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Demands 


1.1. Simple Install 


1.2. Interactive Tutorial 


1.3. Printed Documentation 


1.4. Intuitive Interface 


2.1. Shortcut Keys 


2.2. Saved Reports 


2.3. Saved Drill Downs 


3.1. Bank 


3.2. 56K 


3.3. High speed features 


3.4. Download Reconcile 


3.5. Manage Portfolio 


4.1. Excel Interface 


4.2. Word Link 


5.1. Internet Upgrades 


5.2. Free Internet Fixes 


5.3. Easy Self Help 


5.4. Good Tech Support 
Value 


Categories 


1. Easy to learn 


2. Easy to use 
after learned 


3. Internet 
Connectivity 


4. Works with 
other software 


5. Easy to 
maintain 


Satisfied 
Customer 


Figure 3.17. Customer demand model. 


Customer 
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use in determining customer importance values, it is useful for decision- 
making in general. 


Category importance weights 


We begin our analysis by making pairwise comparisons at the top level. The 
affinity diagram analysis identified five categories: easy to learn, easy to use 
quickly after I’ve learned it, internet connectivity, works well with other soft- 
ware I own, and easy to maintain. Arrange these items in a matrix as shown in 
Figure 3.18. 

For our analysis we will assign verbal labels to our pairwise comparisons; 
the verbal responses will be converted into numerical values for analysis. 
Customers usually find it easier to assign verbal labels than numeric labels. 
All comparisons are made relative to the customer’s goal of determining 
which product he will buy, which we assume is synonymous with our goal 
of determining where to focus product upgrade efforts. The highlighted cell 
in the matrix compares the “easy to learn” attribute and the “easy to use 
quickly after I’ve learned it” attribute. The customer must determine which 
is more important to him, or if the two attributes are of equal importance. 
In Figure 3.18 this customer indicates that “easy to learn” is moderately to 
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Figure 3.18. Matrix of categories for pairwise comparisons. 
Created using Expert Choice 2000 Software, www.expertchoice.com.* 


Easy to learn 

Easy to use quickly after I've learned it 
Internet connectivity 

Works well with other software | own 
Easy to maintain 


* Although the analysis is easier with special software, you can obtain a good approximation using a spreadsheet. See the 
Appendix for details. 
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strongly preferred over “easy to use quickly after I’ve learned it” and the soft- 
ware has placed a +4 in the cell comparing these two attributes. (The scale 
goes from —9 to +9, with “equal” being identified as a +1.) The remaining 
attributes are compared one by one, resulting in the matrix shown in Figure 
3.19. The shaded bars over the attribute labels provide a visual display of the 
relative importance of each major item to the customer. Numerically, the 
importance weights are:* 

° Easy to learn: 0.264 (26.4%) 

° Easy to use quickly after I’ve learned it: 0.054 (5.4%) 

e Internet connectivity: 0.358 (35.8%) 

Works well with other software I own: 0.105 (10.5%) 

e Easy to maintain: 0.218 (21.8%) 

These relative importance weights can be used in QFD as well as in the AHP 
process that we are illustrating here. In our allocation of effort, we will want to 
emphasize those attributes with high importance weights over those with 
lower weights. 


Subcategory importance weights 


The process used for obtaining category importance weights is repeated for 
the items within each category. For example, the items interactive tutorial, 
good printed documentation, and intuitive interface are compared pairwise 
within the category “easy to learn.” This provides weights that indicate the 
importance of each item on the category. For example, within the “easy to 
learn” category, the customer weights might be: 

e Interactive tutorial: 11.7% 

¢ Good documentation: 20.0% 

e Intuitive interface: 68.3% 


oe to lea Easy to uss Internet co Works well Easy to ma 


Easy to learn 4.0 1.0 3.0 1.0 
Easy to use quickly after I've learned it (ee) 0.20 0.33 0.25 
Internet connectivity —S es ees 40 3.0 
Works well with other software | own aa a ) |e) 0.33 


|Easy to maintain wee .05 


Figure 3.19. Completed top-level comparison matrix. 


*See the Appendix for an example of how to derive approximate importance weights using Microsoft Excel. 
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If there were additional levels below these subcategories, the process would 
be repeated for them. For example, the intuitive interface subcategory might 
be subdivided into “number of menus,” “number of submenus,” “menu items 
easily understood,” etc. The greater the level of detail, the easier the translation 
of the customer’s demands into internal specifications. The tradeoff is that the 
process quickly becomes tedious and may end up with the customer being 
asked for input he isn’t qualified to provide. In the case of this example, we'd 
probably stop at the second level. 


Global importance weights 


The subcategory weights just obtained tell us how much importance the 
item has with respect to the category, not with respect to the ultimate goal. 
Thus, they are often called local importance weights. However, the subcate- 
gory weights don’t tell us the impact of the item on the overall goal, which 
is called its global impact. This is determined by multiplying the subcate- 
gory item weight by the weight of the category in which the item resides. 
The global weights for our example are shown in Table 3.4 in descending 
order. 

The global importance weights are most useful for the purpose of allocat- 
ing resources to the overall goal: Determine where to focus product upgrade 
efforts. For our example, Internet connectivity obviously has a huge customer 
impact. “Easy to use quickly after I’ve learned it” has relatively low impact. 
“Easy to learn” is dominated by one item: the user interface. These weights 
will be used to assess different proposed upgrade plans. Each plan will be 
evaluated on each subcategory item and assigned a value depending on how 
well it addresses the item. The values will be multiplied by the global weights 
to arrive at an overall score for the plan. The scores can be rank-ordered to 
provide a list that the process owner can use when making resource alloca- 
tion decisions. Or, more proactively, the information can be used to develop 
a plan that emphasizes the most important customer demands. Table 3.5 
shows part of a table that assesses project plans using the global weights. 
The numerical rating used in the table is O=No Impact, 1=Some Impact, 
3=Moderate Impact, 5=High Impact. Since the global weights sum to 1 
(100%), the highest possible score is 5. Of the five plans evaluated, Plan C 
has the highest score. It can be seen that Plan C has a high impact on the 
six most important customer demands. It has at least a moderate impact on 
10 of the top 11 items, with the exception of “Reasonably priced advanced 
technical support.” These items account for almost 90% of the customer 
demands. 
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Table 3.4. Local and global importance weights. 


Local Global 
Category Subcategory Weight Weight 
Easy to learn Intuitive interface 68.3% 18.0% 
Internet connectivity Online billpay 43.4% 15.5% 
Internet connectivity Download statements 23.9% 8.6% 
Internet connectivity Download investment 23.9% 8.6% 
information 
Works well with other Hotlinks to spreadsheet 75.0% 7.9% 
software 
Easy to maintain Free internet patches 35.7% 7.8% 
Easy to maintain Great, free self-help technical 30.8% 6.7% 
assistance on the internet 
Easy to learn Good documentation 20.0% 5.3% 
Easy to maintain Reasonably priced advanced 20.0% 4.4% 
technical support 
Internet connectivity Works well at 56K 8.9% 3.2% 
Easy to learn Interactive tutorial 11.7% 3.1% 
Easy to maintain Automatic internet upgrades 13.5% 2.9% 
Works well with other Edit reports in word 25.0% 2.6% 
software processor 
Easy to use quickly after’ve — Savable frequently used 43.4% 2.3% 
learned it reports 
Easy to use quickly after’'ve Shortcut keys 23.9% 1.3% 
learned it 
Easy to use quickly afterI’ve | Short menus showing only 23.9% 1.3% 
learned it frequently used 
commands 
Easy to use quickly after ’ve | Macro capability 8.9% 0.5% 


learned it 


The plan’s customer impact score is, of course, only one input into the deci- 
sion-making process. The rigor involved usually makes the score a very valuable 
piece of information. It is also possible to use the same approach to incorporate 
other information, such as cost, timetable, feasibility, etc. into the final decision. 
The process owner would make pairwise comparisons of the different inputs 
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Table 3.5. Example of using global weights in assessing alternatives. 
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PLAN D 3.36 3 3 3 3 3 5 
PLAN E 2.30 5 0 0 0 5 5 1 1 0 1 1 


(customer impact score, cost, feasibility, etc.) to assign weights to them, and use 
the weights to determine an overall plan score. Note that this process is a 
mixture of AHP and QFD. 


Training for Six Sigma 


Education (teaching people how to think differently) and training (teaching 
people how to do things differently) are vital elements in Six Sigma success. 
Although education and training are different, for simplicity we will refer to 
both as simply “training.” 

The Six Sigma organization is unlike the traditional organization and the 
knowledge, skills and abilities (KSAs) required for success in the new organiza- 
tion are different than those possessed by most employees. The new KSAs 
need to be identified and plans need to be developed to assure that employees 
acquire them. The investment required is likely to be significant; careful plan- 
ning is required to assure a good ROI. 


TRAINING NEEDS ANALYSIS 


The first step in the development of the strategic training plan is a training 
needs assessment. The training needs assessment provides the background 
necessary for designing the training program and preparing the training plan. 
The assessment proceeds by performing a task-by-task audit to determine 
what the organization is doing, and comparing it to what the organization 
should be doing. The assessment process focuses on three major areas: 


Process audit—All work is a process. Processes are designed to add values to 
inputs and deliver values to customers as outputs. Are they operating as 
designed? Are they operated consistently? Are they measured at key control 
points? If so, do the measurements show statistical control? The answers to 
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these questions, along with detailed observations of how the process is operated, 
are input to the development of the training plan. 

Assessment of knowledge, skills and abilities—In all probability, there will 
be deficiencies (opportunities for improvement) observed during the process 
audits. Some of these deficiencies will involve employee KSAs. The first prin- 
ciple of self-control is that employees must know what they are doing. 
Management’s job doesn’t end by simply giving an employee responsibility for 
a particular process or task, they must also provide the employee with the 
opportunity to acquire the KSAs necessary to successfully perform their new 
duties. This means that if the employee is asked to assume new duties as a mem- 
ber of a Six Sigma improvement team, they are given training in team skills, if 
they are to keep a control chart, they receive training in the maintenance and 
interpretation of the charts, etc. Since employees are expected to contribute to 
the implementation of the organization’s strategic plan, they should be told 
what the plan is, and how their job contributes to the plan. 

Assessment of employee attitudes—Attitudes are emotions that reflect a 
response to something taking place within an organization. A person’s attitude 
is, in essence, a judgment about the wisdom of a particular course of events. If 
an employee’s attitude is not positive, they will not use their KSAs to help the 
organization as effectively as they could. Negative employee attitudes about 
the direction being taken by the organization indicate that the employee either 
questions the wisdom of the proposed changes, or doubts the sincerity of the 
leadership. Regardless, it represents a problem that must be addressed by the 
training plan. 


The assessments above can be conducted using audits or the survey techniques 
described in Chapter 3. Assessments can be conducted by either internal or exter- 
nal personnel. In general, employees are more likely to be open and honest 
when confidentiality is assured, which is more likely when assessments are con- 
ducted by outside parties. However, internal assessments can reveal valuable 
information if proper safeguards are observed to assure the employee’s privacy. 

It is important that follow-up assessments be made to determine if the train- 
ing conducted closed the gap between the “is” and the “should be.” The follow 
up will also provide a basis for additional training. Reassessment should be con- 
ducted first to assure that the desired KSAs were acquired by the target group 
of employees, then the process should be reassessed to determine if the new 
KSAs improved the process as predicted. It’s common to discover that we 
made a mistake in assuming that the root cause of the process “‘is/should-be” 
gap is a KSA deficiency. If the reassessments indicate that the KSA gap was 
closed but the process gap persists, another approach must be taken to close 
the process gap. 
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THE STRATEGIC TRAINING PLAN 


The strategic training plan is a project plan describing in detail how the gaps 
identified in the training needs analysis will be addressed. As with any project 
plan, the strategic training plan includes a charter containing a detailed descrip- 
tion of the training deliverables, major activities to be undertaken, responsibil- 
ity for each major activity, resources required, deadlines and timetables, etc. In 
most organizations the plan describes several major subprojects, such as the 
leadership training project, the Green Belt, Black Belt and Master Black Belt 
training project, and so on. 

In the traditional organization, the training department is another “silo,” 
with its own budget and special interests to protect. In this system the training 
plans are often not tied to strategic plans. Instead, these plans tend to serve the 
needs of the trainers and others in the training department, rather than serving 
the needs of the organization as a whole. The effect on the organization’s perfor- 
mance is the same as when any organizational unit pursues its own best interest 
rather than the organization’s interests: negative return on investment, 
damaged morale, etc. 

In Six Sigma organizations training plans are tied directly to the current and 
future needs of external customers. These needs are, in turn, the driver behind 
the organization’s strategic plan. The strategic training plan provides the means 
of developing the knowledge, skills, and abilities that will be needed by employees 
in the organization in the future. The people who develop the strategic plan also 
commission the development of the strategic training plan. In many organiza- 
tions, Six Sigma training is a subproject of the Six Sigma deployment plan. The 
training timetable must be tightly linked to the timetable for overall Six Sigma 
deployment. Providing training either too early or too late is a mistake. When 
training is provided too early, the recipient will forget much of what he has 
learned before it is needed. When it is provided too late, the quality of the employ- 
ee’s work will suffer. When it comes to training, just-in-time delivery is the goal. 

The Six Sigma training plan must include a budget. The Six Sigma training 
budget lists those resources that are required to provide the training. The train- 
ing budget traditionally includes a brief cost/benefit analysis. Cost/benefit ana- 
lysis for training, as for all expenditures for intangibles, is challenging. 
Estimating cost is usually simple enough. Examples of training costs include: 

e trainer salaries 

¢ consulting fees 

e classroom space and materials 

¢ lost time from the job 

° staff salaries 

° office space of training staff 


The Strategic Training Plan 153 


Estimating benefits with the same degree of precision is problematic. It is 
usually counterproductive to attempt to get high precision in such estimates. 
Instead, most organizations settle for rough figures on the value of the trainee 
to the company. Some examples of training benefits include: 

¢ improved efficiency 

¢ improved quality 

¢ increased customer satisfaction 

¢ improved employee morale 

¢ lower employee turnover 

¢ increased supplier loyalty 

It isn’t enough to support training in the abstract. Training budgets are tangi- 
ble evidence of management support for the goals expressed in the training 
plan. In addition, management support is demonstrated by participating in the 
development of the strategic training plan. In most cases, senior management 
delegates the development of annual training plans and budgets to the training 
department staff. 


Training needs of various groups 
LEADERSHIP TRAINING 


Leaders should receive guidance in the art of “visioning.” Visioning 
involves the ability to develop a mental image of the organization at a future 
time. Without a vision, there can be no strategy; how can you develop a strat- 
egy without knowing where it is supposed to lead? The future organization 
will more closely approximate the ideal organization, where “ideal” is defined 
as that organization which completely achieves the organization’s values. 
How will such an organization “look”? What will its employees do? Who 
will be its customers? How will it behave towards its customers, employees, 
and suppliers? Developing a lucid image of this organization will help the lea- 
der see how she should proceed with her primary duty of transforming the 
present organization. Without such an image in her mind, the executive will 
lead the organization through a maze with a thousand dead ends. 
Conversely, with her vision to guide her, the transformation process will pro- 
ceed on course. This is not to say that the transformation is ever “easy.” But 
when there is a leader with a vision, it’s as if the organization is following 
an expert scout through hostile territory. The destination is clear, but the 
journey is still difficult. 

Leaders need to be masters of communication. Fortunately, most leaders 
already possess outstanding communication skills; few rise to the top without 
them. However, training in effective communication is still wise, even if it is 
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only refresher training for some. Also, when large organizations are involved, 
communications training should include mass communication media, such as 
video, radio broadcasts, print media, etc. Communicating with customers, 
investors, and suppliers differs from communicating with employees and collea- 
gues, and special training is often required. Communication principles are dis- 
cussed in the previous chapter. 

When an individual has a vision of where he wants to go himself, he can 
pursue this vision directly. However, when dealing with an organization, sim- 
ply having a clear vision is not enough. The leader must communicate the 
vision to the other members of the organization. Communicating a vision is 
a much different task than communicating instructions or concrete ideas. 
Visions of organizations that embody abstract values are necessarily abstract 
in nature. To effectively convey the vision to others, the leader must convert 
the abstractions to concretes. One way to do this is by living the vision. The 
leader demonstrates her values in every action she takes, every decision she 
makes, which meetings she attends or ignores, when she pays rapt attention 
and when she doodles absentmindedly on her notepad. Employees who are 
trying to understand the leader’s vision will pay close attention to the beha- 
vior of the leader. 

Another way to communicate abstract ideas is to tell stories. In organizations 
there is a constant flow of events. Customers encounter the organization 
through employees and systems, suppliers meet with engineers, literally thou- 
sands of events take place every day. From time to time an event occurs that cap- 
tures the essence of the leader’s vision. A clerk provides exceptional customer 
service, an engineer takes a risk and makes a mistake, a supplier keeps the line 
running through a mighty effort. These are concrete examples of what the leader 
wants the future organization to become. She should repeat these stories to 
others and publicly recognize the people who made the stories. She should also 
create stories of her own, even if it requires staging an event. There is nothing 
dishonest about creating a situation with powerful symbolic meaning and 
using it to communicate a vision. For example, Nordstrom has a story about a 
sales clerk who accepted a customer return of a defective tire. This story has tre- 
mendous symbolic meaning because Nordstrom doesn’t sell tires! The story 
illustrates Nordstrom’s policy of allowing employees to use their own best judg- 
ment in all situations, even if they make “mistakes,” and of going the extra 
mile to satisfy customers. However, it is doubtful that the event ever occurred. 
This is irrelevant. When employees hear this story during their orientation 
training, the message is clear. The story serves its purpose of clearly communi- 
cating an otherwise confusing abstraction. 

Leaders need training in conflict resolution. In their role as process owner in 
a traditional organization, leaders preside over a report-based hierarchy trying 
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to deliver value through processes that cut across several functional areas. The 
inevitable result is competition for limited resources, which creates conflict. 
Of course, the ideal solution is to resolve the conflict by designing organizations 
where there is no such destructive competition. Until then, the leader can expect 
to find a brisk demand for his conflict-resolution services. 

Finally, leaders should demonstrate strict adherence to ethical principles. 
Leadership involves trust, and trust isn’t granted to one who violates a moral 
code that allows people to live and work together. Honesty, integrity, and 
other moral virtues should be second nature to the leader. 


BLACK BELT TECHNICAL TRAINING CURRICULA 


Black Belts are expected to deliver tangible results on projects selected to 
have a measurable impact on the organization’s bottom line. This is a big order 
to fill. The means of accomplishing it is an approach (DMAIC or DFSS) and a 
set of techniques that collectively are known as the Six Sigma method. Black 
Belts receive from three to six weeks of training in the technical tools of Six 
Sigma. Three week curricula are usually given to Black Belts working in service 
or transaction-based businesses, administrative areas, or finance. Four week 
programs are common for manufacturing environments.* Six weeks of training 
are provided for Black Belts working in R&D or similar environments. Figure 
4.1 shows the curriculum used for courses in General Electric for personnel 
with finance backgrounds who will be applying Six Sigma to financial, general 
business, and eCommerce processes. Figure 4.2 shows GE’s curriculum for the 
more traditional manufacturing areas. 

Some training companies offer highly compressed two week training 
courses, but I don’t recommend this. My experience with coaching Black Belts, 
as well as student feedback I have received from attendees of four and five 
week training programs, indicates that these are compressed plenty already! 
Even with the six week courses, in some weeks students receive the equivalent 
of two semesters of college-level applied statistics in just a few days. Humans 
require a certain “gestation period” to grasp challenging new concepts and 
stuffing everything into too short a time period is counterproductive. 


SIMULTANEOUS TRAINING AND APPLICATION 


In general, Black Belts are hands-on oriented people selected primarily 
for their ability to get things done. Tools and techniques are provided to 


*A fifth week of training in Lean Manufacturing is often provided for Black Belts working in manufacturing. 
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Week 1 

The DMAIC and DFSS (design for Six Sigma) improvement strategies 
Project selection and “scoping” (Define) 

QFD (quality function deployment) 

Sampling principles (quality and quantity) 

Measurement system analysis (also called “Gage R&R”) 

Process capability 

Basic graphs 

Hypothesis testing 

Regression 


Week 2 

Design of experiments (DOE) (focus on two-level factorials) 
Design for Six Sigma tools 

Requirements flowdown 

Capability flowup (prediction) 

Piloting 

Simulation 

FMEA (failure mode and effects analysis) 

Developing control plans 

Control charts 


Week 3 

Power (impact of sample size) 

Impact of process instability on capability analysis 
Confidence intervals (vs. hypothesis tests) 
Implications of the Central Limit Theorem 
Transformations 

How to detect “lying with statistics” 

General linear models 

Fractional factorial DOEs 


Figure 4.1. Sample curriculum for finance Black Belts. 
From Hoerl, Roger W. (2001), “Six Sigma Black Belts: What Do They Need to Know?”, 
Journal of Quality Technology, 33(4), October, p. 395. Reprinted by permission of ASQ. 


help them do this. Thus, the training emphasis is on application, not theory. 
In addition, many Black Belts will work on projects in an area where they 
possess a high degree of subject-matter expertise. Therefore, Black Belt train- 
ing is designed around projects related to their specific work areas. This 
requires Master Black Belts or trainers with very broad project experience 
to answer application-specific questions. When these personnel aren’t avail- 
able, examples are selected to match the Black Belt’s work as close as poss- 
ible. For example, if no trainer with human resource experience is available 
the examples might be from another service environment; manufacturing 
examples would be avoided. Another common alternative is to use consul- 
tants to conduct the training. Consultants with broad experience within 
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Context’ 

—Why Six Sigma 

—DMAIC and DFSS processes (sequential case studies) 
—Project management fundamentals 

—Team effectiveness fundamentals 


Define’ 

—Project selection 

—Scoping projects 

—Developing a project plan 
—Multigenerational projects 
—Process identification (SIPOC) 


Measure’ 
—QFD 
—Developing measurable CTQs 
—Sampling (data quantity and data quality) 
—Measurement system analysis (not just gage R&R) 
-SPC Part | 
—The concept of statistical control (process stability) 
—The implications of instability on capability measures 
—Capability analysis 


Analyze” 

—Basic graphical improvement tools (“Magnificent 7”) 
—Management and planning tools (Affinity, ID, etc.) 
—Confidence intervals (emphasized) 

—Hypothesis testing (de-emphasized) 

—ANOVA (de-emphasized) 

—Regression 

—Developing conceptual designs in DFSS 


Improve** 
—DOE (focus on two-level factorials, screening designs, and RSM) 
—Piloting (of DMAIC improvements) 
—FMEA 
—Mistake-proofing 
—DFSS design tools 
—CTQ flowdown 
—Capability flowup 
—Simulation 
Conirol* 
—Developing control plans 
-SPC Part Il 


—Control charts 
—Piloting new designs in DFSS 


Figure 4.2. Sample curriculum for manufacturing Black Belts. (The week in which the 
material appears is noted as a superscript.) 
From Hoerl, Roger W. (2001), “Six Sigma Black Belts: What Do They Need to Know?”, 
Journal of Quality Technology, 33(4), October, p. 399. Reprinted by permission of ASQ. 
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the enterprise as well as with other organizations can sometimes offer 
insights. 

Black Belts must work on projects while they are being trained. Typically, 
the training classes are conducted at monthly intervals and project work is 
pursued between classes. One of the critical differences between Six Sigma 
and other initiatives is the emphasis on using the new skills to get tangible 
results. It is relatively easy to sit in a classroom and absorb the concepts 
well enough to pass an exam. It’s another thing entirely to apply the new 
approach to a real-world problem. For one thing, there are other people 
involved. The Black Belt has to be able to use her change agent skills to 
recruit sponsors and team members and to get these people to work together 
on a project with a challenging goal and a tight timetable. The Black Belt is 
not yet comfortable with her new skills and she’s reluctant to go in front of 
others to promote this new approach. But it won’t get any easier. During 
Black Belt training she’ll have the moral support of many others in the same 
situation. The instructors can provide coaching and project-specific training 
and advice. Because she’s new, people will be more forgiving than at any 
future time. In short, there’s no better time to get her feet wet than during 
the training. 


GREEN BELT TRAINING CURRICULUM 


The curriculum for Green Belts is for a one week course (Figure 4.3). The 
same material is sometimes covered in two weeks. The primary difference 
between the one and two week courses is the way in which in-class exercises 
are handled. In some companies Green Belts are provided with their own 
copies of software for statistical analysis, project planning, flowcharting, etc. 
and expected to be able to use the software independently. In others, the 
Green Belt is not expected to be proficient in the use of the software, but 
relies on Black Belts for this service. In the former case, Green Belt training 
is extended to provide the necessary hands-on classroom experience using 
the software. 


“SOFT SKILLS” TRAINING FOR CHANGE AGENTS 


“Belts” seldom do solitary work. In nearly all cases they work with teams, 
sponsors, leadership, etc. Seldom does the Black Belt have any authority to 
direct any member of the team. Thus, as a full-time change agent, the Black 
Belt needs excellent interpersonal skills. Other change agents also need training 
in soft skills. In addition to mastering a body of technical knowledge, Belts and 
other change agents need to be able to: 
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Opening comments 

Red bead demo 

Introduction to Six Sigma 

The DMAIC and DFSS improvement strategies 
Lean manufacturing 


Define 

Project selection, scope, and charter 

Teaming exercise 

Kano 

Process mapping, SIPOC 

FMEA 

Define gate criteria (now to close the Define phase) 


Measure 

CTx: CTQ, CTC, CTS 

Data collection, scales, distributions, yields 

Measurement systems 

-SPC Part | 
—The concept of statistical control (process stability) 
—The implications of instability on capability measures 

Measure gate criteria 


Analyze 

Scatter plots 

Other 7M tools 

Run charts 

Distributions 

Box plots 

Confidence intervals 

Design of experiments (DOE) 
Analyze gate criteria 


Improve 
Benchmarking 
—SPC Part Il 
—Process behavior charts 
Change tools 
Force field analysis 
Project planning and management (improvement planning) 
Improve gate criteria 


Control 

Process control planning matrix 
Process FMEA 

Process control plan 

Control gate criteria 


Figure 4.3. Sample curriculum for Green Belts. 
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¢ Communicate effectively verbally and in writing 

¢ Communicate effectively in both public and private forums 

¢ Work effectively in small group settings as both a participant and a leader 

¢ Work effectively in one-on-one settings 

¢ Understand and carry out instructions from leaders and sponsors 

Too many people believe that so-called soft skills are less important than 
technical skills. Others think that, while soft skills are important, they are easier 
to master. Neither of these beliefs are correct. Soft skills are neither less impor- 
tant nor easier to master, they are just different. In my experience, a change 
agent deficient in soft skills will nearly always be ineffective. They are usually 
frustrated and unhappy souls who don’t understand why their technically brilli- 
ant case for change doesn’t cause instantaneous compliance by all parties. The 
good news is that if the person is willing to apply as much time and effort to 
soft-skill acquisition and mastery as they applied to honing their technical skills, 
they will be able to develop proficiency. 

Soft skills are employed in a variety of ways, such as: 


Coaching—A coach doesn’t simply tell the players what to do, he or she clearly 
explains how to do it. A baseball pitching coach studies the theory of pitching 
and the individual pitcher and provides guidance on how to hold the ball, the 
windup, the delivery, etc. The coach is constantly trying to find ways to help 
the pitcher do a better job. In Six Sigma work there is a coaching chain: leaders 
coach champions and sponsors, champions and sponsors coach Master Black 
Belts, Master Black Belts coach Black Belts, Black Belts coach Green Belts, and 
Green Belts coach team members. Each link in the chain helps the next link 
learn more about doing their job right. 

Mentoring—The mentor understands the organization to such a degree that he 
has acquired deep wisdom regarding the way it works. This allows him to see 
relationships that are not apparent to others. The mentor helps the change 
agent avoid organizational obstacles and to negotiate the barriers. Mentoring 
isn’t so much about the mentor blazing a trail for the change agent as it is 
about providing the change agent with a map for getting things done effectively. 
Negotiation—Change agents must negotiate with others in the organization, 
as well as with suppliers and customers, to acquire the resources necessary to 
accomplish his department’s goals. Obtaining these resources without engen- 
dering ill will requires negotiating skill and diplomacy. 

Conflict resolution—The change agent must coordinate the activities of many 
people, and do so without line authority over any of them. When these people 
cannot resolve their own differences, the change agent must provide guidance. 


Change agents should also receive training in the fundamentals of account- 
ing and finance. Such information is essential to such activities as cost/benefit 
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analysis, budgeting, and quality costs. The goal isn’t to make them accountants, 
but to familiarize them with basic concepts. 

Finally, change agents should possess certain technical skills that are crucial 
to their ability to carry out Six Sigma projects. Change agents must understand 
enough about measurement issues in the social sciences to be able to measure 
the effectiveness of their employee and customer projects. Deming lists an 
understanding of theory of variation as one of the cornerstones of his system 
of profound knowledge. This requires rudimentary statistical skills. Change 
agents without this training will misdiagnose problems, see trends where none 
exist, overreact to random variation, and in general make poor decisions. 


FACILITATOR SKILLS 


Facilitating group activities requires that the change agent possess certain 
unique skills. It is unlikely that an individual who is not already a facilitator 
will already possess the needed skills. Thus, it is likely that facilitator training 
will be needed for change agents. A good part of the facilitator’s job involves 
communicating with people who are working on teams. This role involves the 


following skills: 


Communication skills—Quite simply, the change agent who cannot commu- 
nicate well is of little use to the modern organization. 

Meeting management skills—Schedule the meeting well ahead of time. Be 
sure that key people are invited and that they plan to attend. Prepare an agenda 
and stick to it! Start on time. State the purpose of the meeting clearly at the out- 
set. Take minutes. Summarize from time to time. Actively solicit input from 
those less talkative. Curtail the overly talkative members. Manage conflicts. 
Make assignments and responsibilities explicit and specific. End on time. 
Presentation skills—Know why you are speaking to this audience (inform/ 
educate or convince/persuade); perform the task; solicit the desired audience 
response. 

Presentation preparation—Prepare a list of every topic you want to cover. 
Cull the list to those select few ideas that are most important. Number your 
points. Analyze each major point. Summarize. 

Use of visual aids—A visual aid in a speech is a pictorial used by a speaker to 
convey an idea. Well-designed visual aids add power to a presentation by 
showing the idea more clearly and easily than words alone. Whereas only 
10% of presented material is retained from a verbal presentation after 3 days, 
65% is retained when the verbal presentation is accompanied by a visual aid. 
However, if the visual aids are not properly designed, they can be distracting 
and even counterproductive. ASQ reports that poor visuals generate more 
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negative comment from conference attendees than any other item. Change 
agents must be sensitive to non-verbal communication. There is much more 
to communication than mere words. Facilitators should carefully observe pos- 
ture and body movements, facial expressions, tone of voice, fidgeting, etc. If 
the facilitator sees these non-verbal signals he should use them to determine 
whether or not to intervene. For example, a participant who shakes his head 
when hearing a particular message should be asked to verbalize the reasons 
why he disagrees with the speaker. A person whose voice tone indicates sar- 
casm should be asked to explain the rationale behind his attitude. A wall- 
flower who is squirming during a presentation should be asked to tell the 
group her thoughts. Facilitators should be active listeners. Active listening 
involves certain key behaviors: 

¢ look at the speaker 

¢ concentrate on what the speaker is saying, not on how you will respond to 

it 

¢ wait until the speaker is finished before responding 

¢ focus on the main idea, rather than on insignificant details 

¢ keep emotional reactions under control 

Because all of the work of facilitators involves groups, facilitators should 
have an in-depth understanding of group dynamics and the team process (see 
Chapter 5). Also, because the groups and teams involved are usually working 
on Six Sigma improvement projects, the facilitator should be well versed in 
project management principles and techniques (see Chapters 6 and 15). 


Post-training evaluation and reinforcement 


Training is said to have “worked” if it accomplishes its objectives. Since the 
training objectives are (or should be) derived from the strategic plan, the ulti- 
mate test is whether or not the organization has accomplished its strategic 
objectives. However, training is only one of dozens of factors that determine if 
an organization accomplishes its strategic objectives, and one that is often far 
removed in time from the final result. To assess training effectiveness we need 
more direct measures of success, and we need to measure near the time the train- 
ing has been completed. 

Except in academic settings, imparting knowledge or wisdom is seldom the 
ultimate goal of training. Instead, it is assumed that the knowledge or wisdom 
will result in improved judgments, lower costs, better quality, higher levels of 
customer satisfaction, etc. In other words, the training will produce observable 
results. These results were the focus of the training plan development and train- 
ing needs analysis described earlier in this chapter. Training evaluation requires 
that they be converted to training measurables or objectives. 
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Regardless of the format of the presentation, the basic unit of training is the 
lesson. A lesson is a discrete “chunk” of information to be conveyed to a learner. 
The training objectives form the basis of each lesson, and the lessons provide 
guidance for development of measurements of success. 

Lesson plans provide the basis for measurement at the lowest level. The 
objectives in the lesson plan are specific and the lesson is designed to accomplish 
these specific objectives. The assumption is that by accomplishing the set of 
objectives for each lesson, the objectives of the seminar or other training activity 
will be met. A further assumption is that by meeting the objectives of all of the 
training activities, the objectives of the training plan will be met. Finally, it is 
assumed that by meeting the objectives of the training plan, the objectives of 
the strategic plan (or strategic quality plan) will be met, or at least will not be 
compromised due to training inadequacies. All of these assumptions should be 
subjected to evaluation. 


EVALUATION 


The evaluation process involves four elements (Kirkpatrick, 1996): 

1. Reaction—How well did the conferees like the program? This is 
essentially customer satisfaction measurement. Reaction is usually 
measured using comment sheets, surveys, focus groups and other 
customer communication techniques. See Chapter 3 for additional 
information on these topics. 

2. Learning—What principles, facts, and techniques were learned? What 
attitudes were changed? It is entirely possible that conferees react 
favorably to training, even if learning does not occur. The learning of 
each conferee should be quantified using pre- and post-tests to identify 
learning imparted by the training. Results should be analyzed using 
proper statistical methods. In exceptional cases, e.g., evaluating a con- 
sulting company for a large training contract, a formal designed experi- 
ment may be justified. 

3. Behavior—What changes in behavior on-the-job occurred? If the con- 
feree leaves the SPC presentation and immediately begins to effectively 
apply control charts where none were used before, then the training 
had the desired effect on behavior. However, if the conferee’s tests indi- 
cate that she gained competence in the subject matter from the training, 
but no change in behavior took place, the training investment was 
wasted. Note that behavior change is dependent on a great number of 
factors besides the training, e.g. management must create systems 
where the newly learned behaviors are encouraged. 
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4, Results—What were the tangible results of the program in terms of 
reduced cost, improved quality, improved quantity, etc.? This is the real 
payback on the training investment. The metrics used for measuring 
results are typically built into the action plans, project plans, budgets, 
etc. Again, as with behavior change, there are many factors other than 
training that produce the desired results. 

Phillips adds a fifth item to the above list (Phillips, 1996, p. 316): 

5. Return on investment (ROI)—Did the monetary value of the results 
exceed the cost for the program? 


Phillips considers these five items to be different /evels of evaluation. Each 
evaluation level has a different value, as shown in Figure 4.4. 

Due to the difficulty and cost involved, it is impractical and uneconomical to 
insist that every program be evaluated at all five levels. Sampling can be used to 
obtain evaluations at the higher levels. As an example, one large electric utility 
set the sampling targets in Table 4.1. 

Where sampling is used, programs should be selected using a randomization 
procedure such as random numbers tables. ROI calculations are not difficult 
and they are described in Chapter 4. However, to make the results credible, 
finance and accounting personnel should be involved in calculating financial 
ratios of this type. 


Chain of Value of Power to Frequency of Difficulty of 
Impact Information Show Results Use Assessment 
Reaction Lowest Lowest Frequent Easy 
Learning 


Job Applications 


Results 


, 


ROI Highest Highest Infrequent Difficult 


Figure 4.4. Characteristics of evaluation levels. 
From Phillips, J.J. (1996), “Measuring the Results of Training,” in Craig, R.L., editor in chief, 
The ASTD Training & Development Handbook: A Guide to Human Resources Development. 
New York: McGraw-Hill, p. 317. 
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Table 4.1. Targets for percentages of programs to be evaluated. 
From Phillips, J.J. (1996), “Measuring the Results of Training,” in Craig, 
R.L., editor in chief, The ASTD Training & Development Handbook: A 
Guide to Human Resources Development. New York: McGraw-Hill, p. 317. 


LEVEL PERCENTAGE 
Participant’s satisfaction 100 
Learning 70 
On-the-job-applications (behavior) 50 
Results 10 

ROI 5 
REINFORCEMENT 


When the subject of reinforcement is raised, monetary remuneration usually 
comes to mind first. Skill-based pay is gaining favor in some quarters for a vari- 
ety of reasons: 

¢ encourage employees to acquire additional skills 

¢ reward people for training and education 

¢ asa reaction to the negative aspects of performance-based pay 

While skill-based pay may have merit, cash awards and other such “rewards” 
are of dubious value and should probably not be used. 

Rather than assuming that employees will only engage in training if they 
receive an immediate tangible reward, research and experience indicate that 
most employees find value in training that helps them better achieve their per- 
sonal, job, and career goals. Thus, reinforcement is accomplished by providing 
the trainee with the opportunity to use the skills they learned. Proficiency is 
gained with practice soon after the learning has taken place. Management should 
provide an environment where the new skills can be honed without pressure 
and distraction. The “just-in-time” (JIT) principle applies here. Don’t provide 
training for skills that won’t be used in the near future. 

People who have just learned something new, be it a job skill or a new phi- 
losophy such as quality focus, often have questions arise as they attempt to inte- 
grate their new knowledge into their daily thoughts and routine. User groups 
are very helpful. A user group consists of a number of people who have received 
similar training. User groups meet from time to time to discuss their under- 
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standing of the material with others. The focus of the group varies from “How 
are you using this?” to “I don’t understand this” to “Here’s what I am doing!” 
At times, well-versed speakers will be invited to clarify particular aspects of the 
subject. Presentations of successful applications may be made. Management 
can encourage user groups by providing facilities, helping with administrative 
details, and, especially, by attending their meetings on occasion. 

Electronic forums are gaining in popularity. Trainers will often make them- 
selves available to answer questions via email. Forum subscribers will send 
their questions or comments toa “list server.” The list server then automatically 
broadcasts the question or comment to other subscribers on the list. Every sub- 
scriber receives every user’s message, along with the responses to the message. 
This often produces “threads.” A thread is an exchange of information on a par- 
ticular topic. E.g., subscriber A has a question about using control charts on 
financial data, subscriber B responds, then C responds to B and so on. These 
threads look remarkably like a free-wheeling face-to-face discussion. The result 
is that a great deal of learning takes place in a format that everyone finds to be 
more natural (and more interesting) than a traditional classroom environment. 


REFRESHERS 


Learning that isn’t used right away tends to fade. Even when just-in-time 
training (JITT) is used, it is unlikely that every skill will be put to immediate 
and routine use. It is wise to plan for periodic refresher courses to hone the skills 
acquired during prior training. A refresher course is usually shorter, faster, and 
more intense than new learning. Instructors need not have the same subject mat- 
ter mastery as those teaching new material. In fact, it may not even be necessary 
to have an instructor available. Media such as video and audio tape programs, 
CD ROM, slide presentations, etc., may be sufficient. These self-study media 
offer a number of cost and scheduling advantages. 

If in-house instructors are used, they may be available to answer occasional 
questions from previous trainees. Of course, when the instructor is not a full- 
time trainer, this must be strictly limited. There are a number of ways to reduce 
the demands on the trainer’s time while still answering most of the questions 
from participants. If the need is not urgent, the question may be asked using 
mail or an online forum. House newsletters or bulletins can be used to provide 
answers to frequently asked questions. More companies now have “Intranets” 
where such information is made available. The trainee may be able to find 
an Internet news group devoted to the subject of their concern. There are 
thousands of news groups covering a huge variety of subjects, many relating to 
quality and training. 
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CHAPTER 


Six Sigma Teams 


Six Sigma teams working on projects are the primary means of deploying Six 
Sigma and accomplishing the goals of the enterprise. Six Sigma teams are some- 
times lead by the Black Belt, but the team leader is often the Green Belt or a 
Six Sigma champion who has a passion for the project. Six Sigma teams are com- 
posed of groups of individuals who bring authority, knowledge, skills, abilities 
and personal attributes to the project. There is nothing particularly special 
about Six Sigma teams compared with other work teams. They are people with 
different backgrounds and talents pursuing a common short-term goal. Like all 
groups of people, there are dynamics involved that must be understood if the 
mission of the team is to be accomplished. This chapter addresses the subject 
of what members, Black Belts, Green Belts, sponsors, champions, facilitators, 
and leaders can do to assure that Six Sigma teams are successful. It is not a 
discussion of project management techniques; these are covered elsewhere in 
this book. Instead, this chapter focuses on: 

e Stages in learning to work as a team 

e The difference between group maintenance roles and group task roles 

e Identifying and encouraging productive roles essential to team success 

e Identifying and discouraging counterproductive behavior on teams 

¢ Facilitating team meetings 

¢ Dealing constructively with conflicts 

e Evaluating, recognizing and rewarding teams 


SIX SIGMA TEAMS 


The structure of modern organizations is based on the principle of division of 
labor. Most organizations today consist of a number of departments, each 


Copyright 2003 by The McGraw-Hill Companies, Inc. Click Here for Terms of Use. 


168 


Srx SIGMA TEAMS 


devoted to their own specialty. A fundamental problem is that the separate func- 
tional departments tend to optimize their own operations, often to the detri- 
ment of the organization as a whole. 

Traditional organizations, in effect, create barriers between departments. 
Departmental managers are often forced to compete for shares of limited 
budgets; in other words, they are playing a “zero sum game” where another 
manager's gain is viewed as their department’s loss. Behavioral research has 
shown that people engaged in zero sum games think in terms of win-lose. This 
leads to self-destructive, cut-throat behavior. Overcoming this tendency 
requires improved communication and cooperation between departments. 

Interdepartmental teams are groups of people with the skills needed to deli- 
ver the value desired. Processes are designed by the team to create the value in 
an effective and efficient manner. Management must see to it that the needed 
skills exist in the organization. It is also management’s job to see that they 
remove barriers to cooperation. 

There are two ways to make improvements: improve performance given the 
current system, or improve the system itself. Much of the time improving per- 
formance given the current system can be accomplished by individuals working 
alone. For example, an operator might make certain adjustments to the 
machine. Studies indicate that this sort of action will be responsible for about 
5%~-15% of the improvements. The remaining 85%~—95% of all improvements 
will require changing the system itself. This is seldom accomplished by indivi- 
duals working alone. It requires group action. Thus, the vast majority of Six 
Sigma improvement activity will take place in a group setting. As with nearly 
everything, the group process can be made more effective by acquiring a better 
understanding of the way it works. 


PROCESS IMPROVEMENT TEAMS 


Management of cross-functional projects is discussed in Chapter 15. In this 
section we will focus on the team aspect of process improvement activity. 

Process improvement teams focus on improving one or more important 
characteristics of a process, e.g., quality, cost, cycle time, etc. The focus is on an 
entire process, rather than on a particular aspect of the process. A process is an 
integrated chain of activities that add value. A process can be identified by its 
beginning and ending states, e.g, manufacturing’s beginning state is procure- 
ment, its ending state is shipment. Methods of analyzing and characterizing 
process are discussed throughout this book. Usually several departments are 
involved in any given value-added process. 

Process improvement teams work on both incremental improvement 


(KAIZEN) and radical change (breakthrough). The team is composed of mem- 
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bers who work with the process on a routine basis. Team members typically 
report to different bosses, and their positions can be on different levels of the 
organization’s hierarchy. 

Process improvement projects must be approved by the process owner, 
usually a senior leader in the organization. Process improvement teams must 
be chartered and authorized to pursue process improvement. All of this falls 
in the area of project management. Project management is discussed in 


Chapter 15. 


WORK GROUPS 


Work groups focus on improvement within a particular work area. The work 
area is usually contained within a single department or unit. The process 
owner is usually the department manager. Team members are usually at the 
same level within the organization’s hierarchy and they usually report to one 
boss. 

Work group members are trained in the use of quality control techniques and 
supported by management. The idea is that all workers have an important con- 
tribution to make to the quality effort and the work group is one mechanism 
for allowing them the opportunity to make their contribution. 


Quality circles 


An example of a work group is the quality circle. Quality circles originated 
in Japan and Japanese companies continue to use quality circles on a massive 
scale. Quality circles were tried on a massive scale in America, with only lim- 
ited success. However, the quality circle is the historical forerunner of the 
modern quality improvement work team; a study of them reveals a great 
deal about the success factors needed for successful use of other types of 
work groups. 

Quality circles (circles) are local groups of employees who work to con- 
tinuously improve those processes under their direct control. Here are some 
necessary steps that must be completed before circles can succeed: 

e¢ Management from the top level to the supervisory level must have a clear 
idea of their organization’s purpose. Everyone in the organization must 
be committed to helping the organization achieve its purpose. 

e Senior leadership must have an effective organization for dealing with 
company-wide issues such as quality, cost, cycle time, etc. (e.g., the cross- 
functional form discussed earlier). 

e Attention must be focused on processes rather than on internal politics 
and reporting relationships. 
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¢ Personnel involved must be trained in cooperation skills (e.g., team work, 
group dynamics, communication and presentation skills). This applies to 
area supervisors and managers, not just circle members. 

¢ Personnel involved must be trained in problem-solving skills (e.g., the 

traditional QC tools, the 7M tools, brainstorming, etc.). 

¢ Circle participation must be encouraged by local management. 

This author believes that circles have an important place and that they can 
succeed anywhere providing the proper corporate environment exists. This 
environment did not exist in Western business organizations in the 1970s, and 
for the most part still does not exist. Merely grafting quality circles onto a tradi- 
tional command-and-control hierarchy won’t work. There were many reasons 
why quality circles failed in America; they are the same reasons why work 
groups fail to this day. 

1. The quality circle in an American firm was isolated, not part of a 
company-wide quality control effort. As a result, circles were usually 
unable to deal successfully with problems involving other areas of the 
company. There were no resources in other areas to draw upon. 

2. Key management personnel moved about too frequently and circles 
were not provided with consistent leadership and management 
support. 

3. Employees transferred in and out of circle work areas too frequently. 
Without stability in the membership, circles never developed into effec- 
tive groups. Building effective teams takes time. 


OTHER SELF-MANAGED TEAMS 


In addition to process-improvement teams and work groups, there are many 
other types of teams and groups involved to some extent in Six Sigma. Self-man- 
aged teams are a way to reintegrate work and flatten the management hierarchy. 
If properly implemented and managed, the result can be improved quality and 
productivity. If poorly implemented and managed, the result can be added 
problems. 

Self-managed teams are often given some of the responsibilities that, in tra- 
ditional organizations, are reserved to management. This includes the authority 
to plan and schedule work, hiring, performance assessment, etc. This is essen- 
tially a reversal of over 90 years of scientific management. While difficult to 
implement successfully, the result is a leaner, more efficient organization, 
higher employee morale, and better quality. Several preconditions are necessary 
to assure success: 
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1. Communicate and listen—Encourage two-way, honest, open, frequent 
communication. The more informed employees are, the more secure 
and motivated they will be. 

2. Train employees—An empowering culture is built on the bedrock of 
continuing education in every form imaginable. If an employee doesn’t 
know what to do, how to do it right, or most important, why it is done 
a certain way and what difference it makes, don’t expect him to feel or 
act empowered. 

3. Team employees—No one has found a technological alternative to 
cooperation when it comes to building a positive work climate. Teams 
make it possible for people to participate in decision-making and imple- 
mentation that directly affects them. 

4, Trust employees—Support team decisions even if they aren’t the out- 
comes you had in mind. Trust teams with information and allow them 
to fail. 

5. Feedback—Find people doing things right. Recognize efforts as well as 
results by finding ways to frequently and creatively say thank you. 
Share the glory in every way possible. Give frequent specific perfor- 
mance feedback (good news as well as bad). 


TEAM DYNAMICS MANAGEMENT, INCLUDING 
CONFLICT RESOLUTION 


Conflict management is a duty shared by the facilitator and the team leader. 
The facilitator can assist the leader by assuring that creative conflict is not re- 
pressed, but encouraged. Explore the underlying reasons for the conflict. If 
“personality disputes” are involved that threaten to disrupt the team meeting, 
arrange one-on-one meetings between the parties and attend the meetings to 
help mediate. 

The first step in establishing an effective group is to create a consensus 
decision rule for the group, namely: 


No judgment may be incorporated into the group decision until it meets at 
least tacit approval of every member of the group. 


This minimum condition for group movement can be facilitated by adopting 
the following behaviors: 
e Avoid arguing for your own position. Present it as lucidly and logically as 
possible, but be sensitive to and consider seriously the reactions of the 
group in any subsequent presentations of the same point. 
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e Avoid “win-lose” stalemates in the discussion of opinions. Discard the 
notion that someone must win and someone must lose in the discussion; 
when impasses occur, look for the next most acceptable alternative for 
all the parties involved. 

¢ Avoid changing your mind only to avoid conflict and to reach agreement 
and harmony. Withstand pressures to yield which have no objective or 
logically sound foundation. Strive for enlightened flexibility; but avoid 
outright capitulation. 

¢ Avoid conflict-reducing techniques such as the majority vote, averaging, 
bargaining, coin-flipping, trading out, and the like. Treat differences of 
opinion as indicative of an incomplete sharing of relevant information 
on someone’s part, either about task issues, emotional data, or gut level 
intuitions. 

e View differences of opinion as both natural and helpful rather than as a hin- 
drance in decision-making. Generally, the more ideas expressed, the 
greater the likelihood of conflict will be; but the richer the array of 
resources will be as well. 

¢ View initial agreement as suspect. Explore the reasons underlying appar- 
ent agreements; make sure people have arrived at the same conclusions 
for either the same basic reasons or for complementary reasons before 
incorporating such opinions into the group decision. 

¢ Avoid subtle forms of influence and decision modification. E.g., when a 
dissenting member finally agrees, don’t feel that he must be rewarded by 
having his own way on some subsequent point. 

e Be willing to entertain the possibility that your group can achieve all the 
foregoing and actually excel at its task. Avoid doomsaying and negative 
predictions for group potential. 

Collectively, the above steps are sometimes known as the “consensus 
technique.” In tests it was found that 75% of the groups who were 
instructed in this approach significantly outperformed their best individual 
resources. 


Stages in group development 


Groups of many different types tend to evolve in similar ways. It often helps 
to know that the process of building an effective group is proceeding normally. 
Bruce W. Tuckman (1965) identified four stages in the development of a group: 
forming, storming, norming, and performing. 

During the forming stage a group tends to emphasize procedural matters. 
Group interaction is very tentative and polite. The leader dominates the 
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decision-making process and plays a very important role in moving the group 
forward. 

The storming stage follows forming. Conflict between members, and 
between members and the leader, are characteristic of this stage. Members ques- 
tion authority as it relates to the group objectives, structure, or procedures. It 
is common for the group to resist the attempts of its leader to move them toward 
independence. Members are trying to define their role in the group. 

It is important that the leader deal with the conflict constructively. There are 
several ways in which this may be done: 

¢ Do not tighten control or try to force members to conform to the 

procedures or rules established during the forming stage. If disputes over 
procedures arise, guide the group toward new procedures based on a 
group consensus. 

¢ Probe for the true reasons behind the conflict and negotiate a more accep- 

table solution. 

e Serve as a mediator between group members. 

e Directly confront counterproductive behavior. 

¢ Continue moving the group toward independence from its leader. 

During the norming stage the group begins taking responsibility, or owner- 
ship, of its goals, procedures, and behavior. The focus is on working together 
efficiently. Group norms are enforced on the group by the group itself. 

The final stage is performing. Members have developed a sense of pride in the 
group, its accomplishments, and their role in the group. Members are confident 
in their ability to contribute to the group and feel free to ask for or give assis- 
tance. 


Common problems 


Table 5.1 lists some common problems with teams, along with recommended 
remedial action (Scholtes, 1988). 


Member roles and responsibilities 
PRODUCTIVE GROUP ROLES 


There are two basic types of roles assumed by members of a group: task roles 
and group maintenance roles. Group task roles are those functions concerned 
with facilitating and coordinating the group’s efforts to select, define, and 
solve a particular problem. The group task roles shown in Table 5.2 are generally 
recognized. 
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Table 5.1. Common team problems and remedial action. 


PROBLEM ACTION 
Floundering e Review the plan 

e Develop a plan for movement 
The expert e Talk to offending party in private 


e Let the data do the talking 
e Insist on consensus decisions 


Dominating participants 


e Structure participation 
e Balance participation 
e Actas gate-keeper 


Reluctant participants 


Using opinions instead of 
facts 


e Structure participation 
e Balance participation 
e Actas gate-keeper 


e Insist on data 
e Use scientific method 


Rushing things 


e Provide constructive feedback 
e Insist on data 
e Use scientific method 


Attribution (ie. attributing 
motives to people with 
whom we disagree) 


Ignoring some comments 


e Don’t guess at motives 
e Use scientific method 
e Provide constructive feedback 


e Listen actively 
e Train team in listening techniques 
e Speak to offending party in private 


Wanderlust 


Feuds 


e Follow a written agenda 
e Restate the topic being discussed 


e Talk to offending parties in private 
e Develop or restate groundrules 
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Table 5.2. Group task roles. 


ROLELD. 


DESCRIPTION 


Initiator 


Information seeker 


Proposes new ideas, tasks, or goals; suggests procedures or 
ideas for solving a problem or for organizing the group. 


Asks for relevant facts related to the problem being 
discussed. 


Opinion seeker 


Seeks clarification of values related to problem or 
suggestion. 


Information giver 


Provides useful information about subject under discussion. 


Opinion giver 


Offers his/her opinion of suggestions made. Emphasis is on 
values rather than facts. 


Elaborator Gives examples. 

Coordinator Shows relationship among suggestions; points out issues and 
alternatives. 

Orientor Relates direction of group to agreed-upon goals. 

Evaluator Questions logic behind ideas, usefulness of ideas, or 
suggestions. 

Energizer Attempts to keep the group moving toward an action. 


Procedure technician 


Recorder 


Keeps group from becoming distracted by performing such 
tasks as distributing materials, checking seating, etc. 


Serves as the group memory. 


Another type of role played in small groups are the group maintenance roles. 
Group maintenance roles are aimed at building group cohesiveness and group- 
centered behavior. They include those behaviors shown in Table 5.3. 
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Table 5.3. Group maintenance roles. 


ROLELD. DESCRIPTION 


Encourager Offers praise to other members; accepts the 
contributions of others. 


Harmonizer Reduces tension by providing humor or by promoting 
reconciliation; gets people to explore their differences 
in a manner that benefits the entire group. 


Compromiser This role may be assumed when a group member’s 
idea is challenged; admits errors, offers to modify his/ 
her position. 

Gate-keeper Encourages participation, suggests procedures for 


keeping communication channels open. 


Standard setter Expresses standards for group to achieve, evaluates 
group progress in terms of these standards. 


Observer/commentator Records aspects of group process; helps group 
evaluate its functioning. 


Follower Passively accepts ideas of others; serves as audience in 
group discussions. 


The development of task and maintenance roles is a vital part of the team- 
building process. Team building is defined as the process by which a group 
learns to function as a unit, rather than as a collection of individuals. 


COUNTERPRODUCTIVE GROUP ROLES 


In addition to developing productive group-oriented behavior, it is also 
important to recognize and deal with individual roles which may block the 
building of a cohesive and effective team. These roles are shown in Table 5.4. 

The leader’s role includes that of process observer. In this capacity, the leader 
monitors the atmosphere during group meetings and the behavior of indivi- 
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Table 5.4. Counterproductive group roles. 


ROLE LD. DESCRIPTION 

Aggressor Expresses disapproval by attacking the values, ideas, or 
feelings of other. Shows jealousy or envy. 

Blocker Prevents progress by persisting on issues that have been 


resolved; resists attempts at consensus; opposes without 
reason. 


Recognition-seeker 


Calls attention to himself/herself by boasting, relating 
personal achievements, etc. 


Confessor Uses group setting as a forum to air personal ideologies 
that have little to do with group values or goals. 

Playboy Displays lack of commitment to group’s work by 
cynicism, horseplay, etc. 

Dominator Asserts authority by interrupting others, using flattery to 


manipulate, claiming superior status. 


Help-seeker 


Attempts to evoke sympathy and/or assistance from 
ce ” . 
other members through “poor me” attitude. 


Special-interest pleader 


Asserts the interests of a particular group. This group’s 
interest matches his/her self-interest. 


duals. The purpose is to identify counterproductive behavior. Of course, once 
identified, the leader must tactfully and diplomatically provide feedback to the 
group and its members. The success of Six Sigma is, to a great extent, dependent 
on the performance of groups. 


MANAGEMENT’S ROLE 


Perhaps the most important thing management can do for a group is to give it 
time to become effective. This requires, among other things, that management 
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work to maintain consistent group membership. Group members must not be 
moved out of the group without very good reason. Nor should there be a con- 
stant stream of new people temporarily assigned to the group. If a group is to 
progress through the four stages described earlier in this chapter, to the crucial 
performing stage, it will require a great deal of discipline from both the group 
and management. 

Another area where management must help is creating an atmosphere within 
the company where groups can be effective. 


FACILITATION TECHNIQUES 
When to use an outside facilitator 


It is not always necessary to have an outside party facilitate a group or team. 
While facilitators can often be of benefit, they may also add cost and the use of 
facilitators should, therefore, be carefully considered. The following guidelines 
can be used to determine if outside facilitation is needed (Schuman, 1996): 


1. 


Distrust or bias—In situations where distrust or bias is apparent or sus- 
pected, groups should make use of an unbiased outsider to facilitate 
(and perhaps convene) the group. 

Intimidation—The presence of an outside facilitator can encourage the 
participation of individuals who might otherwise feel intimidated. 
Rivalry—Rivalries between individuals and organizations can be 
mitigated by the presence of an outside facilitator. 

Problem definition—If the problem is poorly defined, or is defined 
differently by multiple parties, an unbiased listener and analyst can 
help construct an integrated, shared understanding of the problem. 
Human limits—Bringing in a facilitator to lead the group process lets 
members focus on the problem at hand, which can lead to better results. 
Complexity or novelty—In a complex or novel situation, a process 
expert can help the group do a better job of working together intellec- 
tually to solve the problem. 

Timelines—If a timely decision is required, as in a crisis situation, the 
use of a facilitator can speed the group’s work. 

Cost—A facilitator can help the group reduce the cost of meeting— 
a significant barrier to collaboration. 


Selecting a facilitator 


Facilitators should possess four basic capabilities (Schuman, 1996): 


Facilitation Techniques 179 


1. Heor she should be able to anticipate the complete problem-solving and 

decision-making processes. 

2. Heorshe should use procedures that support both the group’s social and 

cognitive process. 

3. He or she should remain neutral regarding content issues and values. 

4. Heor she should respect the group’s need to understand and learn from 

the problem solving process. 

Facilitation works best when the facilitator: 

e Takes a strategic and comprehensive view of the problem-solving and 
decision-making processes and selects, from a broad array, the specific 
methods that match the group’s needs and the tasks at hand. 

e Supports the group’s social and cognitive processes, freeing the group 
members to focus their attention on substantive issues. 

e Is trusted by all group members as a neutral party who has no biases or 
vested interest in the outcome. 

¢ Helps the group understand the techniques being used and helps the 
group improve its own problem-solving processes. 


Principles of team leadership and facilitation 

Human beings are social by nature. People tend to seek out the company of 
other people. This is a great strength of our species, one that enabled us to rise 
above and dominate beasts much larger and stronger than ourselves. It is this 
ability that allowed men to control herds of livestock to hunt swift antelope, 
and to protect themselves against predators. However, as natural as it is to 
belong to a group, there are certain behaviors that can make the group function 
more (or less) effectively than their members acting as individuals. 

We will define a group as a collection of individuals who share one or more 
common characteristics. The characteristic shared may be simple geography, 
ie., the individuals are gathered together in the same place at the same time. 
Perhaps the group shares acommon ancestry, like a family. Modern society con- 
sists of many different types of groups. The first group we join is, of course, 
our family. We also belong to groups of friends, sporting teams, churches, 
PTAs, and so on. The groups differ in many ways. They have different purposes, 
different time frames, and involve varying numbers of people. However, all 
effective groups share certain common features. In their work, Joining 
Together, Johnson and Johnson (1999) list the following characteristics of an 
effective group: 

¢ Group goals must be clearly understood, be relevant to the needs of group 

members, and evoke from every member a high level of commitment to 
their accomplishment. 
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Group members must communicate their ideas and feelings accurately 
and clearly. Effective, two-way communication is the basis of all group 
functioning and interaction among group members. 

Participation and leadership must be distributed among members. All 
should participate, and all should be listened to. As leadership needs 
arise, members should all feel responsibility for meeting them. The equal- 
ization of participation and leadership makes certain that all members 
will be involved in the group’s work, committed to implementing the 
group’s decisions, and satisfied with their membership. It also assures 
that the resources of every member will be fully utilized, and increases 
the cohesiveness of the group. 

Appropriate decision-making procedures must be used flexibly if they are 
to be matched with the needs of the situation. There must be a balance 
between the availability of time and resources (such as member’s skills) 
and the method of decision-making used for making the decision. The 
most effective way of making a decision is usually by consensus (see 
below). Consensus promotes distributed participation, the equalization 
of power, productive controversy, cohesion, involvement, and commit- 
ment. 

Power and influence need to be approximately equal throughout the 
group. They should be based on expertise, ability, and access to infor- 
mation, not on authority. Coalitions that help fulfill personal goals should 
be formed among group members on the basis of mutual influence and 
interdependence. 

Conflicts arising from opposing ideas and opinions (controversy) are to be 
encouraged. Controversies promote involvement in the group’s work, 
quality, creativity in decision-making, and commitment to implementing 
the group’s decisions. Minority opinions should be accepted and used. 
Conflicts prompted by incompatible needs or goals, by the scarcity of a 
resource (money, power), and by competitiveness must be negotiated in 
a manner that is mutually satisfying and does not weaken the cooperative 
interdependence of group members. 

Group cohesion needs to be high. Cohesion is based on members liking 
each other, each member’s desire to continue as part of the group, the 
satisfaction of members with their group membership, and the level of 
acceptance, support, and trust among the members. Group norms sup- 
porting psychological safety, individuality, creativeness, conflicts of 
ideas, growth, and change need to be encouraged. 

Problem-solving adequacy should be high. Problems must be resolved 
with minimal energy and in a way that eliminates them permanently. 
Procedures should exist for sensing the existence of problems, inventing 
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and implementing solutions, and evaluating the effectiveness of the solu- 
tions. When problems are dealt with adequately, the problem-solving abil- 
ity of the group is increased, innovation is encouraged, and group 
effectiveness is improved. 

e The interpersonal effectiveness of members needs to be_ high. 
Interpersonal effectiveness is a measure of how well the consequences of 
your behavior match intentions. 

These attributes of effective groups apply regardless of the activity in which 
the group is engaged. It really doesn’t matter if the group is involved in a study 
of air defense, or planning a prom dance. The common element is that there is 
a group of human beings engaged in pursuit of group goals. 


Facilitating the group task process 


Team activities can be divided into two subjects: task-related and main- 
tenance-related. Task activities involve the reason the team was formed, its 
charter, and its explicit goals. 

The facilitator should be selected before the team is formed and he or she 
should assist in identifying potential team members and leaders, and in devel- 
oping the team’s charter. The subject of team formation and project chartering 
is discussed in detail in Chapter 15. 

The facilitator also plays an important role in helping the team develop spe- 
cific goals based on their charter. Goal-setting is an art and it is not unusual to 
find that team goals bear little relationship to what management actually had 
in mind when the team was formed. Common problems are goals that are too 
ambitious, goals that are too limited and goals that assume a cause and effect 
relationship without proof. An example of the latter would be a team chartered 
to reduce scrap assuming that Part X had the highest scrap loss (perhaps based 
on a week’s worth of data) and setting as its goal the reduction of scrap for that 
part. The facilitator can provide a channel of communication between the 
team and management. 

Facilitators can assist the team leader in creating a realistic schedule for the 
team to accomplish its goals. The issue of scheduling projects is covered in 
Chapter 15. 

Facilitators should assure that adequate records are kept on the team’s pro- 
jects. Records should provide information on the current status of the project. 
Records should be designed to make it easy to prepare periodic status reports 
for management. The facilitator should arrange for clerical support with such 
tasks as designing forms, scheduling meetings, obtaining meeting rooms, secur- 
ing audio visual equipment and office supplies, etc. 
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Other activities where the facilitator’s assistance is needed include: 

Meeting management—Schedule the meeting well ahead of time. Be sure 
that key people are invited and that they plan to attend. Prepare an agenda 
and stick to it! Start on time. State the purpose of the meeting clearly at the 
outset. Take minutes. Summarize from time-to-time. Actively solicit input 
from those less talkative. Curtail the overly talkative members. Manage con- 
flicts. Make assignments and responsibilities explicit and specific. End on 
time. 

Communication—The idea that “the quality department” can “assure” or 
“control” quality is now recognized as an impossibility. To achieve quality the 
facilitator must enlist the support and cooperation of a large number of people 
outside of the team. The facilitator can relay written and verbal communication 
between the team and others in the organization. Verbal communication is valu- 
able even in the era of instantaneous electronic communication. A five minute 
phone call can provide an opportunity to ask questions and receive answers 
that would take a week exchanging email and faxes. Also, the team meeting is 
just one communication forum, the facilitator can assist team members in com- 
municating with one another between meetings by arranging one-on-one meet- 
ings, acting as a go-between, etc. 


Facilitating the group maintenance process 


Study the group process. The facilitator is in a unique position to stand 
back and observe the group at work. Are some members dominating the 
group? Do facial expressions and body language suggest unspoken disagree- 
ment with the team’s direction? Are quiet members being excluded from the 
discussion? 

When these problems are observed, the facilitator should provide feedback 
and guidance to the team. Ask the quiet members for their ideas and input. Ask 
if anyone has a problem with the team’s direction. Play devil’s advocate to 
draw out those with unspoken concerns. 


TEAM PERFORMANCE EVALUATION 


Evaluating team performance involves the same principles as evaluating 
performance in general. Before one can determine how well the team’s task 
has been done, a baseline must be established and goals must be identified. 
Setting goals using benchmarking and other means is discussed elsewhere in 
this book (see Chapter 2). Records of progress should be kept as the team 
pursues its goals. 
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Performance measures generally focus on group tasks, rather than on inter- 
nal group issues. Typically, financial performance measures show a payback 
ratio of between 2:1 and 8:1 on team projects. Some examples of tangible 
performance measures are: 

* productivity 

¢ quality 

° cycle time 

© grievances 

* medical usage (e.g., sick days) 

e absenteeism 

° service 

* turnover 

¢ dismissals 

¢ counseling usage 

Many intangibles can also be measured. Some examples of intangibles 
effected by teams are: 

¢ employee attitudes 

* customer attitudes 

* customer compliments 

* customer complaints 

The performance of the team process should also be measured. Project 
failure rates should be carefully monitored. A p chart can be used to evalu- 
ate the causes of variation in the proportion of team projects that succeed. 
Failure analysis should be rigorously conducted. 

Aubrey and Felkins (1988) list the effectiveness measures shown below: 

e leaders trained 

¢ number of potential volunteers 

¢ number of actual volunteers 

¢ percent volunteering 

© projects started 

° projects dropped 

* projects completed/approved 

* projects completed/rejected 

¢ improved productivity 

¢ improved work environment 

¢ number of teams 

¢ inactive teams 

¢ improved work quality 

¢ improved service 

¢ net annual savings 
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TEAM RECOGNITION AND REWARD 


Recognition is a form of employee motivation in which the company iden- 
tifies and thanks employees who have made positive contributions to the com- 
pany’s success. In an ideal company, motivation flows from the employees’ 
pride of workmanship. When employees are enabled by management to do 
their jobs and produce a product or service of excellent quality, they will be 
motivated. 

The reason recognition systems are important is not that they improve work 
by providing incentives for achievement. Rather, they make a statement about 
what is important to the company. Analyzing a company’s employee recogni- 
tion system provides a powerful insight into the company’s values in action. 
These are the values that are actually driving employee behavior. They are not 
necessarily the same as management’s stated values. For example, a company 
that claims to value customer satisfaction but recognizes only sales achieve- 
ments probably does not have customer satisfaction as one of its values in 
action. 

Public recognition is often better for two reasons: 

1. Some (but not all) people enjoy being recognized in front of their collea- 

gues. 

2. Public recognition communicates a message to all employees about the 
priorities and function of the organization. 

The form of recognition can range from a pat on the back to a small gift toa 
substantial amount of cash. When substantial cash awards become an estab- 
lished pattern, however, it signals two potential problems: 

1. It suggests that several top priorities are competing for the employee’s 
attention, so that a large cash award is required to control the employee’s 
choice. 

2. Regular, large cash awards tend to be viewed by the recipients as part of 
the compensation structure, rather than as a mechanism for recognizing 
support of key corporate values. 

Carder and Clark (1992) list the following guidelines and observations 

regarding recognition: 

Recognition is not a method by which management can manipulate employ- 
ees. If workers are not performing certain kinds of tasks, establishing a recogni- 
tion program to raise the priority of those tasks might be inappropriate. 
Recognition should not be used to get workers to do something they are not cur- 
rently doing because of conflicting messages from management. A more effec- 
tive approach is for management to first examine the current system of 
priorities. Only by working on the system can management help resolve the 
conflict. 
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Recognition is not compensation. In this case, the award must represent 
a significant portion of the employee’s regular compensation to have sig- 
nificant impact. Recognition and compensation differ in a variety of 
ways: 

¢ Compensation levels should be based on long-term considerations such as 
the employee’s tenure of service, education, skills, and level of responsibil- 
ity. Recognition is based on the specific accomplishments of individuals 
or groups. 

¢ Recognition is flexible. It is virtually impossible to reduce pay levels once 
they are set, and it is difficult and expensive to change compensation plans. 

e Recognition is more immediate. It can be given in timely fashion and 
therefore relate to specific accomplishments. 

e Recognition is personal. It represents a direct and personal contact 
between employee and manager. Recognition should not be carried out 
in sucha manner that implies that people of more importance (managers) 
are giving something to people of less importance (workers). 

Positive reinforcement is not always a good model for recognition. Just because 
the manager is using a certain behavioral criterion for providing recognition, it 
doesn’t mean that the recipient will perceive the same relationship between 
behavior and recognition. 

Employees should not believe that recognition is based primarily on luck. An 
early sign of this is cynicism. Employees will tell you that management says 
one thing but does another. 

Recognition meets a basic human need. Recognition, especially public recog- 
nition, meets the needs for belonging and self-esteem. In this way, recognition 
can play an important function in the workplace. According to Abraham 
Maslow’s theory, until these needs for belonging and self-esteem are satisfied, 
self-actualizing needs such as pride in work, feelings of accomplishment, 
personal growth, and learning new skills will not come into play. 

Recognition programs should not create winners and losers. Recognition pro- 
grams should not recognize one group of individuals time after time while 
never recognizing another group. This creates a static ranking system, with all 
of the problems discussed earlier. 

Recognition should be given for efforts, not just for goal attainment. 
According to Imai (1986), a manager who understands that a wide variety 
of behaviors are essential to the company will be interested in criteria 
of discipline, time management, skill development, participation, morale, 
and communication, as well as direct revenue production. To be able to 
effectively use recognition to achieve business goals, managers must 
develop the ability to measure and recognize such process accomplish- 
ments. 
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Employee involvement is essential in planning and executing a recognition 
program. It is essential to engage in extensive planning before instituting a 


recognition program or before changing a bad one. The perceptions and expec- 
tations of employees must be surveyed. 
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CHAPTER 


Selecting and Tracking Six 
Sigma Projects* 


The best Six Sigma projects begin not inside the business but outside it, 
focused on answering the question: How can we make the customer more 
competitive? What is critical to the customer’s success? Learning the answer 
to that question and learning how to provide the solution is the only focus 
we need. 

Jack Welch, CEO, General Electric 


This chapter covers the subject of Six Sigma project selection. Project man- 
agement, monitoring, results capture, and lessons learned capture and dissemi- 
nation are discussed in Chapter 15. Projects are the core activity driving 
change in the Six Sigma organization. Although change also takes place due to 
other efforts, such as Kaizen, project-based change is the force that drives break- 
through and cultural transformation. In a typical Six Sigma organization 
about one percent of the workforce is engaged full time in change activities, 
and each of these change agents will complete between three and seven projects 
in a year. In addition there are another five percent or so part-time change 
agents, each of whom will complete about two smaller projects per year. The 
mathematics translate to about 500 major projects and 1,000 smaller projects 


*Some of the material in this chapter is from The Six Sigma Project Planner, by Thomas Pyzdek. © 2003 by McGraw-Hill. 


Copyright 2003 by The McGraw-Hill Companies, Inc. Click Here for Terms of Use. 
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in an organization with 10,000 employees in any given year. Clearly, learning 
how to effectively deal with projects is critical to Six Sigma success. 


CHOOSING THE RIGHT PROJECTS 


Projects must be focused on the right goals. This is the responsibility of the 
senior leadership, e.g., the project sponsor, Executive Six Sigma Council or 
equivalent group. Senior leadership is the only group with the necessary author- 
ity to designate cross-functional responsibilities and allow access to interdepart- 
mental resources. Six Sigma projects will impact one of the major stakeholder 
groups: customers, shareholders, or employees. Although it is possible to calcu- 
late the impact of any given project on all three groups, I recommend that initi- 
ally projects be evaluated separately for each group. This keeps the analysis 
relatively simple and assures that a good stakeholder mix is represented in the 
project portfolio. 


Customer value projects 


Many, if not most Six Sigma projects are selected because they have a positive 
impact on customers. To evaluate such projects one must be able to determine 
the linkage between business processes and customer-perceived value. Chapter 
3 discussed how to create organizations that are customer-driven, which is 
essential. Customer-driven organizations, especially process enterprises, focus 
on customer value as a matter of routine. This focus will generate many Six 
Sigma customer value projects in the course of strategy deployment. However, 
in addition to the strategy-based linkage of Six Sigma projects described in 
Chapter 3, there is also a need to use customer demands directly to generate 
focused Six Sigma projects. The techniques for obtaining this linkage are the 
same as those used in Chapter 3. The difference is that the focus here is not on 
strategy deployment or budgeting, but on Six Sigma improvement projects 
focused on specific customer demands. 

Learning what customers value is primarily determined by firsthand contact 
with customers through customer focus groups, interviews, surveys, etc. The 
connection between customer-perceived value and business processes, or “cus- 
tomer value streams,” is established through business process mapping (see 
Chapter 8) and quality function deployment (QFD). The Executive Six Sigma 
Council and project sponsors should carefully review the results of these efforts 
to locate the “lever points” where Six Sigma projects will have the greatest 
impact on customer value. 
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Shareholder value projects 

Six Sigma provides a “double-whammy” by addressing both efficiency and 
revenues. Revenue is impacted by improving the customer value proposition, 
which allows organizations to charge premium prices for superior quality, or to 
keep prices competitive and increase sales volume and market share due to super- 
ior quality. Improved efficiency is achieved by reducing the cost of poor quality, 
reducing cycle time, or eliminating waste in business processes. To determine 
which Six Sigma projects address the issue of business process efficiency evaluate 
the high-level business process maps (including SIPOC) and flow charts. 


Other Six Sigma projects 
Some Six Sigma projects address intangibles, such as employee morale, regu- 
latory concerns, or environmental issues. These projects can be just as impor- 
tant as those which address customer or shareholder value. 


ANALYZING PROJECT CANDIDATES 


You now have a list of candidate Six Sigma projects. Assuming that the orga- 
nization has limited resources, the next task is to select a subset of these projects 
to fund and staff. 

Projects cost money, take time, and disrupt normal operations and standard 
routines. For these reasons projects designed to improve processes should be 
limited to processes that are important to the enterprise. Furthermore, projects 
should be undertaken only when success is highly likely. Feasibility is deter- 
mined by considering the scope and cost of a project and the support it receives 
from the process owner. In this section a number of techniques and approaches 
are presented to help identify those projects that will be chosen for Six Sigma. 


Benefit-cost analysis 

Benefit-cost analysis can be as elaborate or as simple as the magnitude of the 
project expenditures demands. The Six Sigma manager is advised that most 
such analyses are easier to “sell” to senior management if done by (or reviewed 
and approved by) experts in the finance and accounting department. The plain 
fact is that the finance department has credibility in estimating cost and benefit 
that the Six Sigma department, and any other department, lacks. The best 
approach is to get the finance department to conduct the benefit-cost analysis 
with support from the other departments involved in the project. We will pro- 
vide an overview of some principles and techniques that are useful in benefit- 
cost analysis. 
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A fundamental problem with performing benefit-cost analysis is that, in gen- 
eral, it is easier to accurately estimate costs than benefits. Costs can usually be 
quantified in fairly precise terms in a budget. Costs are claims on resources the 
firm already has. In contrast, benefits are merely predictions of future events, 
which may or may not actually occur. Also, benefits are often stated in units 
other than dollars, making the comparison of cost and benefit problematic. The 
problem is especially acute where quality improvement projects are concerned. 
For example, a proposed project may involve placing additional staff on a custo- 
mer “hot line.” The cost is easy to compute: X employees at a salary of SY each, 
equipment, office space, supervision, etc. The benefit is much more difficult to 
determine. Perhaps data indicate that average time on hold will be improved, 
but the amount of the improvement and the probability that it will occur are 
speculations. Even if the time-on-hold improvement were precise, the impact 
on customer satisfaction would be an estimate. And the association between cus- 
tomer satisfaction and revenues is yet another estimate. Still, the intelligent man- 
ager will realize that despite these difficulties, reasonable cause-and-effect 
linkages can be established to form the basis for benefit-cost analysis. Such is 
often the best one can expect. To compensate for the uncertainties associated 
with estimates of benefits, it makes sense to demanda relatively high ratio of ben- 
efit to cost. For example, it is not unusual to have senior leadership demand a 
ROI of 100% in the first year on a Six Sigma project. Rather than becoming dis- 
tressed at this “injustice,” the Black Belt should realize that such demands are a 
response to the inherent difficulties in quantifying benefits. 


A system for assessing Six Sigma projects 


Assessing Six Sigma projects is an art as well as a science. It is also critical to 
the success of Six Sigma, and to the individual Black Belt. Far too many Black 
Belts fail because they are not discriminating enough in their selection of pro- 
jects. If project selection is systematically sloppy, the entire Six Sigma effort 
can fail. 

The approach offered here is quantitative in the sense that numbers are deter- 
mined and an overall project score calculated. It is subjective to a degree because 
it requires interpretation of the situation, estimating probabilities, costs, and 
commitments, etc. However, the rigor that goes with completing this assess- 
ment process will help you make better judgments regarding projects. The num- 
bers (weights, scores, acceptable length of projects, dollar cutoffs, etc.) are 
strictly my own personal judgments; feel free to assign your own values or 
those of your leadership. The scale ranges from 0 to 9 for each criterion, and 
the weights sum to 1.00, so the highest possible weighted score for a project is 9. 
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The Six Sigma department or Process Excellence function can compile sum- 
mary listings of project candidates from these assessments. Sorting the list in 
descending order provides a guide to the final decision as to which projects to 
pursue. Each Black Belt or Green Belt will probably have their own list, which 
can also be sorted and used to guide their choices. 


Worksheet 1. Six Sigma project evaluation. 


Project Name: Date of Assessment: 
Black Belt: Master Black Belt: 
Weighted Overall Project Score: Project Number: 
Weighted 

Criteria Score Weight | Score* 
1. Sponsorship 0.23 
2. Benefits (specify main beneficiary) Overall 

2.1 External Customer: Benefit Score 

2.2 Shareholder: 0.19 


2.3 Employee or internal customer: 


2.4 Other (e.g., supplier, environment): 


3. Availability of resources other than team 0.16 
4. Scope in terms of Black Belt Effort 0.12 
5. Deliverable 0.09 
6. Time to complete 0.09 
7. Team membership 0.07 
8. Project Charter 0.03 
9. Value of Six Sigma Approach 0.02 
TOTAL (sum of weighted score column) 1.00 


Note: Any criterion scores of zero must be addressed before project is approved. 


*Weighted score = project’s score for each criterion times the weight. 
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Worksheet 2. Six Sigma project evaluation guidelines. 


1.0 Sponsorship 


Score Interpretation 


| Director-level sponsor identified, duties specified and sufficient 
time committed and scheduled 


3 Director-level sponsor identified, duties specified and sufficient 
time committed but not scheduled 


1 Willing Director-level sponsor who has accepted charter 
statement 
0 Director-level sponsor not identified, or sponsor has not 


accepted the charter 


2.0 Stakeholder Benefits* 


“Tangible and verifiable benefits for a major stakeholder” 


2.1 Stakeholder: External Customer 
2.1.1 Customer Satisfaction 


Score Interpretation 


9 Substantial and statistically significant increase in overall 
customer satisfaction or loyalty 


3 Substantial and statistically significant increase in a major 
subcategory of customer satisfaction 


1 Substantial and statistically significant increase in a focused 
area of customer satisfaction 


0) Unclear or non-existent customer satisfaction impact 


*Note: Several stakeholder benefit categories are shown in section 2. At least one stakeholder category is required. Show ben- 


efit scores for each category, then use your judgment to determine an overall benefit score for the project. 
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2.1.2 Quality Improvement (CTQ) 


Score Interpretation 

9 10x or greater improvement in critical to quality (CTQ) metric 

5 5 x to 10X improvement in CTQ metric 

3 2x to5xX improvement in CTQ metric 

1 Statistically significant improvement in CTQ metric, but less than 
2x magnitude 

0 Project’s impact on CTQ metrics undefined or unclear 


2.2 Stakeholder: Shareholder 


2.2.1 Financial Benefits 


Score Interpretation 

9 Hard net savings (Budget or Bid Model change) greater than 
$500K. Excellent ROI 

5 Hard net savings between $150K and $500K. Excellent ROI 

3 Hard net savings between $50K and $150K, or cost avoidance 
greater than $500K. Good ROI 

1 Hard savings of at least $50K, or cost avoidance of between $150K 
and $500K. Acceptable ROI 

0 Project claims a financial benefit but has hard savings less than 
$50K, cost avoidance less than $150K, or unclear financial benefit 


2.2.2 Cycle Time Reduction 


Score Interpretation 

9 Cycle time reduction that improves revenue, Bid Model or Budget 
by more than $500K. Excellent ROI 

5 Cycle time reduction that improves revenue, Bid Model or Budget 
by $150K to $500K. Excellent ROI 


Continued on next page... 
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2.2.2 (cont.) 


3 


Cycle time reduction that improves revenue, Bid Model or Budget 
by $50K to $150K, or creates a cost avoidance of more than $500K. 
Good ROI 


Cycle time reduction that results in cost avoidance between $150K 
and $500K. Acceptable ROI 


Project claims a cycle time improvement but has hard savings less 
than $50K, cost avoidance less than $150K, or unclear financial 
benefit from the improvement in cycle time 


2.2.3 Revenue Enhancement 


Score 


Interpretation 


Significant increase in revenues, excellent ROI 


Moderate increase in revenues, good ROI 


Increase in revenues with acceptable ROI 


Unclear or non-existent revenue impact 


2.3 Stakeholder: Employee or Internal Customer 
2.3.1 Employee Satisfaction 


Score 


Interpretation 


Substantial and statistically significant increase in overall 
employee satisfaction 


Substantial and statistically significant increase in a major element 
of employee satisfaction 


Substantial and statistically significant increase in a focused area 
of employee satisfaction 


Unclear or non-existent employee satisfaction impact 
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2.4 Stakeholder: Other 
2.4.1 Specify Stakeholder: 


Benefits 


Score Interpretation 


) Unclear or non-existent benefit 


3.0 Availability of Resources Other Than Team 


Score Interpretation 

9 Needed resources available when needed 

3 Limited or low priority access to needed to resources 

0 Resources not available, or excessive restrictions on access to 
resources 
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4.0 Scope in Terms of Black Belt Effort 


Score Interpretation 

9 Projected return substantially exceeds required return 

3 Projected return exceeds required return 

1 Projected return approximately equals required return 

0 Projected return not commensurate with required return 


Required return can be calculated as follows:* 


(1) Length of project (months) = 
(2) Proportion of Black Belt’s time required (between 0 and 1) = 


(3) Probability of success (between 0 and 1) = 
Required return** = $83,333 x (1) x (2) + (3) =$ 


Projected return: $ 


5.0 Deliverable (Scope) 


Score Interpretation 


9 New or improved process, product or service to be created is 
clearly and completely defined 


3 New or improved process, product or service to be created is 
defined 
0 Deliverable is poorly or incorrectly defined. For example, a 


“deliverable” that is really a tool such as a process map 


*Thanks to Tony Lin of Boeing Satellite Systems for this algorithm. 


**Based on expected Black Belt results of $1 million/year. 
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6.0 Time to Complete 


Score Interpretation 

9 Results realized in less than 3 months 

3 Results realized in between 3 and 6 months 

1 Results realized in 7 to 12 months 

0 Results will take more than 12 months to be realized 


7.0 Team Membership 


Score Interpretation 

9 Correct team members recruited and time commitments scheduled 

3 Correct team members recruited, time committed but not 
scheduled 

1 Correct team members recruited 

) Team members not recruited or not available 


8.0 Project Charter 


Score Interpretation 


| All elements of the project charter are complete and acceptable. 
Linkage between project activities and deliverable is clear 


3 Project charter acceptable with minor modifications 


0) Project charter requires major revisions 


9.0 Value of Six Sigma Approach (DMAIC or equivalent) 


Score Interpretation 


9 Six Sigma approach essential to the success of the project. Black 
Belt/Green Belt skill set required for success 


rc) Six Sigma approach helpful but not essential. Black Belt/Green 
Belt skill set can be applied 


0 Usefulness of Six Sigma approach not apparent. Specific Black Belt 


or Green Belt skills are not necessary 
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Other methods of identifying promising 
projects 


Projects should be selected to support the organization’s overall strategy 
and mission. Because of this global perspective most projects involve the 
efforts of several different functional areas. Not only do individual projects 
tend to cut across organizational boundaries, different projects are often 
related to one another. To effectively manage this complexity it is necessary 
to integrate the planning and execution of projects across the entire enter- 
prise. One way to accomplish this is QFD, which is discussed in detail else- 
where in this book (see Chapter 3, “Using QFD to link Six Sigma projects 
to strategies”). In addition to QFD and the scoring method described above, 
a number of other procedures are presented here to help identify a project’s 
potential worth. 


USING PARETO ANALYSIS TO IDENTIFY SIX SIGMA 
PROJECT CANDIDATES 


Pareto principle refers to the fact that a small percentage of processes 
cause a large percentage of the problems. The Pareto principle is useful in 
narrowing a list of choices to those few projects that offer the greatest 
potential (see Chapter 8). When using Pareto analysis keep in mind that 
there may be hidden “pain signals.” Initially problems create pain signals 
such as schedule disruptions and customer complaints. Often these symp- 
toms are treated rather than their underlying “diseases”; for example, if 
quality problems cause schedule slippages which lead to customer com- 
plaints, the “solution” might be to keep a large inventory and sort the 
good from the bad. The result is that the schedule is met and customers 
stop complaining, but at huge cost. These opportunities are often greater 
than those currently causing “pain,” but they are now built into business 
systems and therefore very difficult to see. One solution to the hidden pro- 
blem phenomenon is to focus on processes rather than symptoms. Some 
guidelines for identifying dysfunctional processes for potential improve- 
ment are shown in Table 6.1. 

The “symptom” column is useful in identifying problems and setting priori- 
ties. The “disease” column focuses attention on the underlying causes of the 
problem, and the “cure” column is helpful in chartering quality improvement 
project teams and preparing mission statements. 
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Table 6.1. Dysfunctional process symptoms and underlying diseases. 


Symptom 


Disease 


Cure 


Extensive information 
exchange, data redundancy, 
rekeying 


Inventory, buffers, and 
other assets stockpiled 


Arbitrary fragmentation of 
a natural process 


System slack to cope with 
uncertainty 


Discover why people need 
to communicate with each 
other so often; integrate 
the process 


Remove the uncertainty 


High ratio of checking and 
control to value-added 
work (excessive test and 
inspection, internal 
controls, audits, etc.) 


Rework and iteration 


Fragmentation 


Inadequate feedback in a 
long work process 


Eliminate the 
fragmentation, integrate 
processes 


Process control 


Complexity, exceptions and 
special causes 


Accretion onto a simple 
base 


Uncover original “clean” 
process and create new 
process(es) for special 
situations; eliminate 
excessive standardization 
of processes 


PRIORITIZING PROJECTS WITH THE PARETO 
PRIORITY INDEX 


After a serious search for improvement opportunities the organization’s lea- 
ders will probably find themselves with more projects to pursue than they 
have resources. The Pareto Priority Index (PPI) is a simple way of prioritizing 
these opportunities. The PPI is calculated as follows (Juran and Gryna, 1993, 


p- 49): 


PPE = 


Savings x probability of success 


(6.1) 


Cost x time to completion (years) 
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A close examination of the PPI equation shows that it is related to return 
on investment adjusted for probability of success. The inputs are, of course, 
estimates and the result is totally dependent on the accuracy of the inputs. 
The resulting number is an index value for a given project. The PPI values 
allow comparison of various projects. If there are clear standouts the PPI 
can make it easier to select a project. Table 6.2 shows the PPIs for several 
hypothetical projects. 


Table 6.2. Illustration of the Pareto Priority Index (PPI). 


Savings $ Cost, $ 
Project thousands Probability | thousands | Time, years PPI 


Reduce wave 
solder defects 
50% 


NC machine 
capability 
improvement 


ISO 9001 
certification 


Eliminate 
customer 
delivery 
complaints 


Reduce 
assembly 
defects 50% 


The PPI indicates that resources be allocated first to reducing wave solder 
defects, then to improving NC machine capability, and so on. The PPI may 
not always give such a clear ordering of priorities. When two or more projects 
have similar PPIs a judgment must be made on other criteria. 
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Throughput-based project selection 

While careful planning and management of projects is undeniably impor- 
tant, they matter little if the projects being pursued have no impact on the bot- 
tom line (throughput). As you will see below, if you choose the wrong projects 
it is possible to make big “improvements” in quality and productivity that 
have no impact whatever on the organization’s net profit. Selecting which pro- 
jects to pursue is of critical importance. In this section we will use the theory 
of constraints (TOC) to determine which project(s) to pursue. 


THEORY OF CONSTRAINTS 


Every organization has constraints. Constraints come in many forms. When 
a production or service process has a resource constraint (i.e., it lacks a sufficient 
quantity of some resource to meet the market demand), then the sequence of 
improvement projects should be identified using very specific rules. According 
to Eliyahu M. Goldratt (1990), the rules are: 

1. Identify the system’s constraint(s). Consider a fictitious company that 
produces only two products, P and Q (Figure 6.1). The market demand 
for P is 100 units per week and P sells for $90 per unit. The market 
demand for Q is 50 units per week and Q sells for $100 per unit. 
Assume that A, B, C and D are workers who have different non-inter- 


$90/U 
100 U/Wk 


Cc (C B 
10 min/U 5 min/U 15 min/U 
A B A 
15 min/U 15 min/U 10 min/U 
RM1 RM2 RM3 
$20/U $20/U $20/U 


Figure 6.1. A simple process with a constraint. 
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changeable skills and that each worker is available for only 2,400 minutes 
per week (8 hours per day, 5 days per week). For simplicity, assume that 
there is no variation, waste, etc. in the process. This process has a con- 
straint, Worker B. This fact has profound implications for selecting Six 
Sigma projects. 

2. Decide how to exploit the system’s constraint (s). Look for Six Sigma pro- 
jects that minimize waste of the constraint. For example, if the con- 
straint is the market demand, then we look for Six Sigma projects that 
provide 100% on time delivery. Let’s not waste anything! If the constraint 
is a machine, focus on reducing setup time, eliminating scrap, and keep- 
ing the machine running as much as possible. 

3. Subordinate everything else to the above decision. Choose Six Sigma pro- 
jects to maximize throughput of the constraint. After completing step 
2, choose projects to eliminate waste from downstream processes; once 
the constraint has been utilized to create something we don’t want to 
lose it due to some downstream blunder. Then choose projects to assure 
that the constraint is always supplied with adequate non-defective 
resources from upstream processes. We pursue upstream processes last 
because by definition they have slack resources, so small amounts of 
waste upstream that are detected before reaching the constraint are less 
damaging to throughput. 

4. Elevate the system’s constraint(s). Elevate means “Lift the restriction.” 
This is step #74, not step #72! Often the projects pursued in steps 2 and 
3 will eliminate the constraint. If the constraint continues to exist after 
performing steps 2 and 3, look for Six Sigma projects that provide addi- 
tional resources to the constraint. These might involve, for example, pur- 
chasing additional equipment or hiring additional workers with a 
particular skill. 

5. If, in the previous steps, a constraint has been broken, go back to step 1. 
There is a tendency for thinking to become conditioned to the existence 
of the constraint. A kind of mental inertia sets in. If the constraint has 
been lifted, then you must rethink the entire process from scratch. 
Returning to step 1 takes you back to the beginning of the cycle. 


COMPARISON OF TOC AND TRADITIONAL 


APPROACHES 


It can be shown that the TOC approach is superior to the traditional TQM 
approaches to project selection. For example, consider the data in the table 
below. If you were to apply Pareto analysis to scrap rates you would begin 
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with Six Sigma projects that reduced the scrap produced by Worker A. In fact, 
assuming the optimum product mix, Worker A has about 25% slack time, so 
the scrap loss can be made up without shutting down Worker B, who is the con- 
straint. The TOC would suggest that the scrap loss of Worker B and the down- 
stream processes C and D be addressed first, the precise opposite of what 
Pareto analysis recommends. 


Process Scrap Rates. 


Process A B C D 


Scrap Rate || 8% | 3% | 5% | 7% 


Of course, before making a decision as to which projects to finance cost/ben- 
efit analyses are still necessary, and the probability of the project succeeding 
must be estimated. But by using the TOC you will at least know where to look 
first for opportunities. 


USING CONSTRAINT INFORMATION TO FOCUS SIX 


SIGMA PROJECTS 


Applying the TOC strategy described above tells us where in the process to 
focus. Adding CTx information (see Table 6.3) can help tell us which type of 
project to focus on, i.e., should we focus on quality, cost or schedule projects? 
Assume that you have three Six Sigma candidate projects, all focusing on pro- 
cess step B, the constraint. The area addressed is correct, but which project 
should you pursue first? Let’s assume that we learn that one project will primar- 
ily improve quality, another cost, and another schedule. Does this new informa- 
tion help? Definitely! Take a look at Table 6.3 to see how this information can 
be used. Projects in the same priority group are ranked according to their impact 
on throughput. 

The same thought process can be applied to process steps before and after the 
constraint. The results are shown in Table 6.4. 

Note that Table 6.4 assumes that projects before the constraint do not 
result in problems at the constraint. Remember, impact should always be 
measured in terms of throughput. If a process upstream from the constraint 
has an adverse impact on throughput, then it can be considered to be a con- 
straint. If an upstream process average yield is enough to feed the constraint 
on the average, it may still present a problem. For example, an upstream pro- 
cess producing 20 units per day with an average yield of 90% will produce, 
on average, 18 good units. If the constraint requires 18 units, things will be 
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Table 6.3. Throughput priority of CTx projects that affect the constraint. 


Project 
Type Discussion 


CTQ Any unit produced by the constraint is especially valuable because if it is lost 
as scrap additional constraint time must be used to replace it or rework it. 
Since constraint time determines throughput (net profit of the entire system), 
the loss far exceeds what appears on scrap and rework reports. CTQ projects 
at the constraint are the highest priority. 


CTS CTS projects can reduce the time it takes the constraint to produce a unit, 
which means that the constraint can produce more units. This directly 
impacts throughput. CTS projects at the constraint are the highest priority. 


CTC Since the constraint determines throughput, the cost of the constraint going 
down is the lost throughput of the entire system. This makes the cost of 
constraint down time extremely high. The cost of operating the constraint is 
usually miniscule by comparison. Also, CTC projects often have an adverse 
impact on quality or schedule. Thus, CTC projects at the constraint are low 
priority. 


Table 6.4. Project throughput priority versus project focus. 


Focus of Six Sigma Project 
Before the At the After the 
CTX: constraint constraint | constraint 
Characteristic Quality (CTQ) van © oO 
addressed is 
criticalto... Cost (CTC) O A O 
Schedule (CTS) A Oo O 


A Low throughput priority. 
O Moderate throughput priority. 
© High throughput priority. 
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okay about 50% of the time, but the other 50% of the time things won’t be 
okay. One solution to this problem is to place a work-in-process (WIP) inven- 
tory between the process and the constraint as a safety buffer. Then on those 
days when the process yield is below 18 units, the inventory can be used to 
keep the constraint running. However, there is a cost associated with carrying 
a WIP inventory. A Six Sigma project that can improve the yield will reduce 
or eliminate the need for the inventory and should be considered even if it 
doesn’t impact the constraint directly, assuming the benefit-cost analysis justi- 
fies the project. On the other hand, if an upstream process can easily make 
up any deficit before the constraint needs it, then a project for the process 
will have a low priority. 

Knowing the project’s throughput priority will help you make better 
project selection decisions by helping you select from among project candi- 
dates. Of course, the throughput priority is just one input into the project 
selection process, other factors may lead to a different decision. For example, 
impact on other projects, a regulatory requirement, a better payoff in the 
long-term, etc. 


Multi-tasking and project scheduling 

A Six Sigma enterprise will always have more projects to pursue than it has 
resources to do them. The fact that resources (usually Black Belts or Green 
Belts) are scarce means that projects must be scheduled, i.e., some projects 
must be undertaken earlier than others. In such situations it is tempting to use 
multi-tasking of the scarce resource. Multi-tasking is defined as the assignment 
of a resource to several priorities during the same period of time. The logic is 
that by working on several projects or assignments simultaneously, the entire 
portfolio of work will be done more quickly. However, while this is true for 
independent resources working independent projects or subprojects in parallel, 
it is mot true when applied to a single resource assigned to multiple projects or 
interdependent tasks within a project. 

Consider the following situation. You have three Six Sigma projects, A, B, 
and C. A single-tasking solution is to first do A, then B, and then C. Here’s the 
single-activity project schedule. 


A B Cc 
(Complete in wk. 10) (Complete in wk. 20) (Complete in wk. 30) 


If each project takes 10 weeks to complete, then A will be completed in 10 
weeks, B in 20 weeks, and C in 30 weeks. The average time to complete the 
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three projects is (10 + 20 + 30)/3 = 60/3 = 20 weeks. The average doesn’t tell 
the whole story, either. The benefits will begin as soon as the project is com- 
pleted and by the end of the 30 week period project A will have been completed 
for 20 weeks, and project B for 10 weeks. 

Now let’s consider a multi-tasking strategy. Here we split our time equally 
between the three projects in a given 10 week period. That way the sponsor of 
projects B and C will see activity on their projects much sooner than if we used 
a single-task approach to scheduling. The new schedule looks like this: 


A B C A B C A B C 


With this multi-tasking schedule project A will be completed in 23.3 weeks, 
project B in 26.7 weeks, and project C will still take 30 weeks. The completion 
time for project A went from 10 weeks to 23.3 weeks, for project B it went 
from 20 weeks to 26.7 weeks, and for project C it remained the same, 30 
weeks. The overall average completion time went from 20 weeks to 26.67 
weeks, a 33% deterioration in average time to complete. And this is a best- 
case scenario. In real life there is always some lost time when making the tran- 
sition from one project to another. The Black Belt has to clear her head of 
what she was doing, review the next project, get the proper files ready, re- 
awaken sponsors and team members, and so on. This can often take a consid- 
erable amount of time, which is added to the time needed to complete the 
projects. 


CRITICAL CHAIN PROJECT PORTFOLIO 
MANAGEMENT 


Critical chain project management avoids the multi-tasking problem by 
changing the way the organization manages groups of projects, and the way 
the individual projects are managed. 


Managing the organization’s projects 

First, at the organizational level, multi-tasking of key resources is 
stopped. People and other resources are allowed to focus on projects one at 
a time. This means that management must accept responsibility for prioritiz- 
ing projects, and policies must be developed which mandate single-project 
focus and discourage multi-tasking. To be successful the organization must 
determine its capacity to complete projects. Every organization finds itself 
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with more opportunities than it can successfully pursue with finite 
resources. This means that only a select portfolio of projects should be 
undertaken in any time interval. The constraining resource is usually a key 
position in the organization, say the time available by project sponsors, engi- 
neers, programmers, etc. This information can be used to determine organi- 
zational capacity and to schedule project start dates according to the 
availability of the key resource. This is called project launch synchronization 
and the scarce resource that paces the project system is called a synchronizer 
resource. 


Synchronizer resource usage 

Critical chain project management does not permit multi-tasking of scarce 
resources. People and equipment that are fully utilized on projects, synchroni- 
zer resources, are assigned to a sequence of single projects. The sequence of 
projects is based on enterprise priorities. If a project requires one or more syn- 
chronizer resources it is vital that your project start dates integrate the sche- 
dules of these resources. In particular, this will require that those activities 
that require time from a synchronizer resource (and the project as a whole) 
stipulate “Start no earlier than” dates. Although synchronizer resources are 
protected by capacity buffers and might hypothetically start at a date earlier 
than specified, the usual practice is to utilize any unplanned excess capacity 
to allow the organization to pursue additional opportunities, thereby increas- 
ing the organization’s capacity to complete projects. Note that human 
resources are defined in terms of the skills required for the activity, not in 
terms of individual people. In fact, the resource manager should refrain from 
assigning an activity to an individual until all predecessors have been com- 
pleted and the activity is ready to begin. This precludes the temptation to 
multi-task as the individual looks ahead and sees the activity start date draw- 
ing near. 

Project start dates are determined by beginning with the highest priority 
project and calculating the end date for the synchronizing resource based 
on the estimated duration of all activities that require the synchronizing 
resource. The second highest priority project’s start date will be calculated 
by adding a capacity buffer to the expected end date of the first project. 
The third highest priority project’s start date is based on the completion 
date of the second, and so on. If, by chance, the synchronizing resource is 
available before the scheduled start date, the time can be used to increase 
the organization’s capacity to complete more projects. Figure 6.2 illustrates 
this strategy. 
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Ga Non-synchronizer activity PBS Project buffer 


F , 
; CBA Capacity buffer 
ne 


Figure 6.2. Critical chain scheduling illustration. 


Summary and preliminary project selection 

At this point you have evaluated project candidates using a number of 
different criteria. You must now rank the projects, and make your preliminary 
selections. You may use Worksheet 3 to assist you with this. The reason your 
selections are preliminary is that you lack complete data. As they work the pro- 
ject, Six Sigma project teams will continuously reevaluate it and they may 
uncover data which will lower or raise the project’s priority. The project spon- 
sor is responsible for coordinating changes in priority with the process owners. 


TRACKING SIX SIGMA PROJECT RESULTS 


It is vital that information regarding results be accumulated and reported. 
This is useful for a variety of purposes: 
Evaluating the effectiveness of the Six Sigma project selection system 
Determining the overall return on investment 


Setting budgets 
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Worksheet 3. Project assessment summary. 


Project Description Project PPI ROI Throughput 
or ID Number Score Priority Priority Priority Comments 


Appraising individual and group performance 

Setting goals and targets 

Identifying areas where more (or less) emphasis on Six Sigma is indicated 
Helping educate newcomers on the value of Six Sigma 

Answering skeptics 

Quieting cynics 

A major difference between Six Sigma and failed programs of the past is the 
emphasis on tangible, measurable results. Six Sigma advocates make a strong 
point of the fact that projects are selected to provide a mixture of short- and 
long-term paybacks that justify the investment and the effort. Unless proof is 
provided any statements regarding paybacks are nothing more than empty 
assertions. 

Data storage is becoming so inexpensive that the typical organization can 
afford to keep fairly massive amounts of data in databases. The limiting factor 
is the effort needed to enter the data into the system. This is especially important 
if highly trained change agents such as Master Black Belts, Black Belts, or 
Green Belts are needed to perform the data entry (Table 6.5). 

Usually viewing access is restricted to the project data according to role 
played in the project, position in the organization, etc. Change access is usually 
restricted to the project sponsor, leader, or Black Belt. However, to the extent 
possible, it should be easy to “slice-and-dice” this information in a variety of 
ways. Periodic reports might be created summarizing results according to 
department, sponsor, Black Belt, etc. The system should also allow ad-hoc 
views to be easily created, such as the simple list shown in Table 6.6. 
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Table 6.5. Possible information to be captured. 


Charter information (title, sponsor, membership, deadline etc.) 


Description of project in ordinary language 


Project status 


Savings type (hard, soft, cost avoidance, CTQ, etc.) 


Process or unit owner 


Key accounting information (charge numbers, etc.) 


Project originator 


Top-level strategy addressed by project 
Comments, issues 


Lessons learned 


Keywords (for future searches) 


Related documents and links 


Audit trail of changes 


Project task and schedule information 


Table 6.6. A typical view of Six Sigma projects. 


Project Project Savings Total 

ID Title Status Black Belt Sponsor Due Type Savings Costs 

76 Cup Pending J Jones Jane Doe | 3/1/04 Hard $508,000 | $5,900 
Dipole approval 
Antenna 

33 Tank Define BOlson Sam 9/30/03 | Hard $250,000 | $25,000 
assembly Smith 

35 SSPA Completed | NHepburn | Sal Davis | 10/31/03 | Cost $1.3 $13,000 

avoidance | Million 

37 FCCRFI | Control M Littleton | Henry 9/30/03 | Other NA $1,500 

compliance Little 
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Financial results validation 

Six Sigma financial benefits claimed for every project must be confirmed by 
experts in accounting or finance. Initial savings estimates may be calculated by 
Black Belts or sponsors, but final results require at least the concurrence of the 
finance department. This should be built in from the start. The finance person 
assigned to work with the team should be listed in the project charter. Without 
this involvement the claimed savings are simply not credible. Aside from the 
built-in bias involved in calculating the benefit created from one’s own project, 
there is the issue of qualifications. The best qualified people to calculate finan- 
cial benefits are generally those who do such calculations for a living. 

This is not to imply that the finance expert’s numbers should go unchal- 
lenged. If the results appear to be unreasonable, either high or low, then they 
should be clearly explained in terms the sponsor understands. The Six Sigma 
Leader also has an interest in assuring that the numbers are valid. Invalid results 
pose a threat to the viability of the Six Sigma effort itself. For example, on one 
project the Black Belt claimed savings of several hundred thousand dollars for 
“unpaid overtime.” A finance person concurred. However, the Six Sigma 
Leader would not accept the savings, arguing quite reasonably that the company 
hadn’t saved anything if it had never paid the overtime. This isn’t to say that 
the project didn’t have a benefit. Perhaps morale improved or turnover declined 
due to the shorter working hours. Care must be taken to show the benefits 


properly. 


TYPES OF SAVINGS 


The accounting or finance department should formally define the different 
categories of savings. Savings are typically placed in categories such as: 

Hard savings are actual reductions in dollars now being spent, such as 
reduced budgets, fewer employees, reduction of prices paid on purchasing 
contracts, etc. Hard savings can be used to lower prices, change bid mod- 
els, increase profits, or for other purposes where a high degree of confi- 
dence in the benefit is required. 

Soft savings are projected reductions that should result from the project. 
For example, savings from less inventory, reduced testing, lower cycle 
times, improved yields, lower rework rates, reduced scrap. 

It is important that savings be integrated into the business systems of the 
organization. If the institutional framework doesn’t change, the savings could 
eventually be lost. For example, if a Six Sigma project improves a process 
yield, be sure the MRP system’s calculations reflect the new yields. 
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Financial analysis 
TIME VALUE OF MONEY 


Financial analysis of benefit and cost 

In performing benefit-cost analysis it is helpful to understand some of the 
basic principles of financial analysis, in particular, break-even analysis and the 
time value of money (TVM). 

Let’s assume that there are two kinds of costs: 

1. Variable costs are those costs which are expected to change at the same 
rate as the firm’s level of sales. As more units are sold, total variable 
costs will rise. Examples include sales commissions, shipping costs, 
hourly wages and raw materials. 

2. Fixed costs are those costs that are constant, regardless of the quantity 
produced, over some meaningful range of production. Total fixed cost 
per unit will decline as the number of units increases. Examples of fixed 
costs include rent, salaries, depreciation of equipment, etc. 

These concepts are illustrated in Figure 6.3. 


TOTAL 
COSTS 


TOTAL 
VARIABLE 
COSTS 


DOLLARS 


TOTAL FIXED 
COSTS 


UNITS PRODUCED 


Figure 6.3. Fixed and variable costs. 
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Break-even points 
We can define the break-even point, or operating break-even point as the level 
of unit sales required to make earnings before interest and taxes (EBIT) equal 
to zero, ie., the level of sales where profits cover both fixed and variable costs. 
Let Q be the quantity sold, P the price per unit, V the variable cost per unit, 
and F the total fixed costs. Then the quantity P—V represents the variable profit 
per unit and 


Q(P — V) — F = EBIT (6.2) 


If we set EBIT equal to zero in Equation 6.2 and solve for the break-even 
quantity Q* we get: 


e=s—, (6.3) 


Example of break-even analysis 
A publishing firm is selling books for $30 per unit. The variable costs are $10 
per unit and fixed costs total $100,000. The break-even point is: 


F $100,000 


* . 
= — = —— = 5,000 units 
C2 P—V _ $30— $10 
Of course, management usually wishes to earn a profit rather than to merely 
break even. In this case, simply set EBIT to the desired profit rather than zero 
in Equation 6.2 and we get the production quantity necessary to meet manage- 


ment’s target: 


F + EBITyyrcer 


PV (6.4) 


QTARGET = 


For example, if the publisher mentioned above wishes to earn a $5,000 profit 
then the break-even level of sales becomes 


F + EBITr4rcer __ $100,000 + $5,000 
P—V $30 — $10 


QrarGET = = 5,250 units 


In project benefit-cost analysis these break-even quantities are compared to 
the sales forecasts to determine the probability that the expected return will 
actually be earned. 
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The time value of money 

Because money can be invested to grow to a larger amount, we say that 
money has a “time value.” The concept of time value of money underlies much 
of the theory of financial decision making. We will discuss two TVM concepts: 
future value and present value. 

Future value. Assume that you have $1,000 today and that you can invest this 
sum and earn interest at the rate of 10% per year. Then, one year from today, 
your $1,000 will have grown by $100 and it will be worth $1,100. The $1,100 fig- 
ure is the future value of your $1,000. The $1,000 is the present value. Let’s call 
the future value FV, the present value PV and the interest rate i, where 7 is 
expressed as a proportion rather than as a percentage. Then we can write this 
example algebraically as follows: 


FV =PV +PV xi =PV(1 +i) 


Now, let’s say that you could invest at the 10% per year rate for two years. 
Then your investment would grow as follows: 


YEAR | STARTING AMOUNT | INTEREST | ENDING AMOUNT 


1 $1,000 $100 $1,100 
2 $1,100 $110 $1,210 


Observe that in year 7/2 you earned interest on your original $1,000 and on 
the $100 interest you earned in year #41. The result is that you earned more 
interest in year #72 than in year 7/1. This is known as compounding. The year 
time interval is known as the compounding period. Thus, the FV after two years 
is $1,210. Algebraically, here’s what happened: 


FV = [$1,000(1.10)](1.10) = $1,000(1.10)? 


Where the value between the [ | characters represents the value at the end of 
the first year. This approach can be used for any number of N compounding 
periods. The equation is: 


FV =PV(1 +i)" (6.5) 
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Of course, Equation 6.5 can be solved for PV as well, which gives us the pre- 
sent value of some future amount of money at a given rate of interest. 


FV 


Ve — = 
(1 +i)% 


(6.6) 


Non-annual compounding periods 

Note that N can be stated in any time interval, it need not be in years. For 
example, if the compounding period was quarterly then N would be the number 
of quarters. Of course, the interest rate would also need to be stated in quarters. 
For example, if the $1,000 were invested for two years at 10% per year, com- 
pounded quarterly, then 


0.1 2x4 
FV = PV(1+i)% = s1,000(1 + =) = $1,000(1 + 0.025)* = $1,218.40 


Continuous compounding 

Note that the FV is greater when a greater number of compounding periods 
are used. The limit is an infinite number of compounding periods, known as 
continuous compounding. For continuous compounding the PV and FV equa- 
tions are: 


FV =PVxeé™ (6.7) 
FV 
Va (6.8) 


Where t is the length of time (in years) the sum is compounded, e is a constant 
2.71828, and all other terms are as previously defined. For our example, we 
have a two-year period which gives 


FV =PV x e'™ = $1,000 x 2.7182818°!*? = $1,221.40 


Net present value 

When evaluating project costs and benefits, it often happens that both costs 
and benefits come in cash flow streams, rather than in lump sums. 
Furthermore, the cash flow streams are uneven, i.e., the amounts vary from 
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one period to the next. The approach described above can be used for uneven 
cash flow streams as well. Simply compute the PV (or FV) of each cash flow sepa- 
rately and add the various results together. The result of applying this procedure 
is called the net present value, or NPV. The procedure, while conceptually easy 
to grasp, becomes tedious quite quickly. Fortunately, most spreadsheets have a 
built in capability to perform this analysis. 

Assume that a proposed project has the projected costs and benefits shown in 
the table below. 


YEAR COST BENEFIT 
1 $10,000 $o 
2 $2,000 $500 
3 $O $5,000 
4 $0 $10,000 
5 NO) $15,000 


Also assume that management wants a 12% return on their investment. What 
is the NPV of this project? 

There are two ways to approach this question, both of which produce the 
same result (Figure 6.4). One method would be to compute the net difference 
between the cost and benefit for each year of the project, then find the NPV of 
this cash flow stream. The other method is to find the NPV of the cost cash 
flow stream and benefit cash flow stream, then subtract. 

The NPV of the cost column is $10,523; the NPV of the benefits is $18,824. 
The project NPV can be found by subtracting the cost NPV from the benefit 
NPV, or by finding the NPV of the yearly benefit minus the yearly cost. 
Either way, the NPV analysis indicates that this project’s net present value 
is $8,301. 


INTERNAL RATE OF RETURN 

Often in financial analysis of projects, it is necessary to determine the yield of 
an investment in a project given its price and cash flows. For example, this may 
be the way by which projects are prioritized. When faced with uneven cash 
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D9 ly] «| =NPV@BST DED 
Ela NPU calculation worksheet 
ae A eo se ae 
Rate % 
Year Cost Benefit Net 


1 $10,000 $0 ($10,000) 
2 $2000 $500 ($1,500) 
3 $0 $5,000 $5,000 
4 $0 $10,000 $10,000 
5 $0 $15,000 $15,000 
V . : 


Figure 6.4. Using Excel to find the net present value of a project. 


flows, the solution to this type of problem is usually done by computer. For 
example, with Microsoft Excel, we need to make use of the internal rate of 
return (IRR) function. The IRR is defined as the rate of return which equates 
the present value of future cash flows with the cost of the investment. To find 
the IRR the computer uses an iterative process. In other words, the computer 
starts by taking an initial “guess” for the IRR, determines how close the com- 
puted PV is to the cost of the investment, then adjusts its estimate of the IRR 
either upward or downward. The process is continued until the desired degree 
of precision has been achieved. 


Example 

A quality improvement team in a hospital has been investigating the problem 
of lost surgical instruments. They have determined that in the rush to get the 
operating room cleaned up between surgeries many instruments are acci- 
dentally thrown away with the surgical waste. A test has shown that a $1,500 
metal detector can save the following amounts: 
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Year Savings 
1 $750 
2 $1,000 
3 $1,250 
4 $1,500 
5 $1,750 


After five years of use the metal detector will have a scrap value of $250. To 
find the IRR for this cash flow stream we set up the Excel spreadsheet and 
solve the problem as illustrated in Figure 6.5. 

The Excel formula, shown in the window at the top of the figure, was built 
using the Insert Formula “wizard,” with the cash flows in cells B2:B7 and an 
initial guess of 0.1 (10%). Note that in year ##5 the $250 salvage value is added 
to the expected $1,750 in savings on surgical instruments. The cost is shown as 


Year Cash Flow 


1 

2 0 

3 1 

4 2 

5 3 $1,250 
6 4 

f =) 

8 

rm 


Figure 6.5. Using Excel to find the internal rate of return for a project. 
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a negative cash flow in year 0. Excel found the IRR to be 63%. The IRR can be 
one of the criteria for prioritizing projects, as an alternative to, or in addition 
to, using the PPI. 


COST OF (POOR) QUALITY 


The history of quality costs dates back to the first edition of Juran’s QC 
Handbook in 1951. Today, quality cost accounting systems are part of every 
modern organization’s quality improvement strategy. Indeed, quality cost 
accounting and reporting are part of many quality standards. Quality cost sys- 
tems help management plan for Six Sigma by identifying opportunities for 
greatest return on investment. However, leadership should keep in mind that 
quality costs address only half of the quality equation. The quality equation 
states that quality consists of doing the right things and not doing the wrong 
things. “Doing the right things” means including product and service features 
that satisfy or delight the customer. “Not doing the wrong things” means avoid- 
ing defects and other behaviors that cause customer dissatisfaction. Quality 
costs address only the latter aspect of quality. It is conceivable that a firm 
could drive quality costs to zero and still go out of business. 

A problem exists with the very name “cost of quality.” By using this termi- 
nology, we automatically create the impression that quality is a cost. However, 
our modern understanding makes it clear that quality is not a cost. Quality 
represents a driver that produces higher profits through lower costs and the abil- 
ity to command a premium price in the marketplace. This author concurs with 
such quality experts as H.J. Harrington and Frank M. Gryna that a better term 
would be “cost of poor quality.” However, we will bow to tradition and use 
the familiar term “cost of quality” throughout this discussion. 

The fundamental principle of the cost of quality is that any cost that would 
not have been expended if quality were perfect is a cost of quality. This includes 
such obvious costs as scrap and rework, but it also includes many costs that are 
far less obvious, such as the cost of reordering to replace defective material. 
Service businesses also incur quality costs; for example, a hotel incurs a quality 
cost when room service delivers a missing item to a guest. Specifically, quality 
costs are a measure of the costs associated with the achievement or non-achieve- 
ment of product or service quality—including all product or service require- 
ments established by the company and its contracts with customers and 
society. Requirements include marketing specifications, end-product and pro- 
cess specifications, purchase orders, engineering drawings, company proce- 
dures, operating instructions, professional or industry standards, government 
regulations, and any other document or customer needs that can affect the defi- 
nition of product or service. More specifically, quality costs are the total of the 
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cost incurred by a) investing in the prevention of non-conformances to require- 
ments; b) appraising a product or service for conformance to requirements; 
and c) failure to meet requirements (Figure 6.6). 


PREVENTION COSTS 

The costs of all activities specifically designed to prevent poor quality in products or 
services. Examples are the costs of new product review, quality planning, supplier 
capability surveys, process capability evaluations, quality improvement team meet- 
ings, quality improvement projects, quality education and training. 


APPRAISAL COSTS 

The costs associated with measuring, evaluating or auditing products or services to 
assure conformance to quality standards and performance requirements. These 
include the costs of incoming and source inspection/test of purchased material, in 
process and final inspection/test, product, process, or service audits, calibration of 
measuring and test equipment, and the costs of associated supplies and materials. 


FAILURE COSTS 

The costs resulting from products or services not conforming to requirements or cus- 
tomer/user needs. Failure costs are divided into internal and external failure cost 
categories. 


INTERNAL FAILURE COSTS 

Failure costs occurring prior to delivery or shipment of the product, or the furnishing of 
a service, to the customer. Examples are the costs of scrap, rework, reinspection, 
retesting, material review, and down grading. 


EXTERNAL FAILURE COSTS 

Failure costs occurring after delivery or shipment of the product, and during or after 
furnishing of a service, to the customer. Examples are the costs of processing cus- 
tomer complaints, customer returns, warranty claims, and product recalls. 


TOTAL QUALITY COSTS 

The sum of the above costs. It represents the difference between the actual cost of a 
product or service, and what the reduced cost would be if there was no possibility of 
substandard service, failure of products, or defects in their manufacture. 


Figure 6.6. Quality costs—general description. 
From Principles of Quality Costs, 3rd Edition, p.5, Jack Campanella, Editor. 
Copyright ©1999 by ASQ Quality Press. 
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For most organizations, quality costs are hidden costs. Unless specific qual- 
ity cost identification efforts have been undertaken, few accounting systems 
include provision for identifying quality costs. Because of this, unmeasured 
quality costs tend to increase. Poor quality impacts companies in two ways: 
higher cost and lower customer satisfaction. The lower satisfaction creates 
price pressure and lost sales, which results in lower revenues. The combination 
of higher cost and lower revenues eventually brings ona crisis that may threaten 
the very existence of the company. Rigorous cost of quality measurement is 
one technique for preventing such a crisis from occurring. Figure 6.7 illustrates 
the hidden cost concept. 


COMMONLY 
rare MEASURED 
REWORK 
WARRANTY FAILURE 
COSTS 
GE el escsaee se 
TRUE 
ENGINEERING TIME FAILURE 

MANAGEMENT TIME COSTS 


SHOP AND FIELD DOWNTIME 


INCREASED INVENTORY PARORE 
DECREASED CAPACITY COSTS 
DELIVERY PROBLEMS 


LOST ORDERS 


Figure 6.7. Hidden cost of quality and the multiplier effect. 
From Principles of Quality Costs, 2nd Edition, p. 11, Jack Campanella, Editor. 
Copyright © 1990 by ASQ Quality Press. 


Goal of quality cost system 

The goal of any quality cost system is to reduce quality costs to the lowest 
practical level. This level is determined by the total of the costs of failure and 
the cost of appraisal and prevention. Juran and Gryna (1988) present these 
costs graphically as shown in Figure 6.8. In the figure it can be seen that the 
cost of failure declines as conformance quality levels improve toward perfec- 
tion, while the cost of appraisal plus prevention increases. There is some “‘opti- 
mum.” target quality level where the sum of prevention, appraisal, and failure 
costs is at a minimum. Efforts to improve quality to better than the optimum 
level will result in increasing the total quality costs. 
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Total cost—, 


Optimum quality level 


COST 


\ 


Failure cost Prevention cost 


Perfect quality —- 
QUALITY LEVEL 


Figure 6.8. Classical model of optimum quality costs. 


From Juran’s Quality Control Handbook, 4th edition, J.M. Juran and F.M. Gryna, Editors. 


Copyright © 1988, McGraw-Hill. 


Juran acknowledged that in many cases the classical model of optimum qual- 
ity costs is flawed. It is common to find that quality levels can be economically 
improved to literal perfection. For example, millions of stampings may be pro- 
duced virtually error-free from a well-designed and built stamping die. The clas- 
sical model created a mindset that resisted the idea that perfection was a 
possibility. No obstacle is as difficult to surmount as a mindset. The new 
model of optimum quality cost incorporates the possibility of zero defects and 
is shown in Figure 6.9. 

Quality costs are lowered by identifying the root causes of quality problems 
and taking action to eliminate these causes. The tools and techniques described 
in Part IL are useful in this endeavor. KAIZEN, reengineering, and other contin- 
uous improvement approaches are commonly used. 


Strategy for reducing quality costs 

Asa general rule, quality costs increase as the detection point moves further 
up the production and distribution chain. The lowest cost is generally obtained 
when non-conformances are prevented in the first place. If non-conformances 
occur, it is generally least expensive to detect them as soon as possible after 
their occurrence. Beyond that point there is loss incurred from additional 
work that may be lost. The most expensive quality costs are from non-confor- 


Tracking Six Sigma Project Results 223 


TOTAL 
QUALITY COSTS 


FAILURE 
COSTS 


COST PER GOOD UNIT OF PRODUCT 


COSTS OF APPRAISAL 
PLUS PREVENTION 


QUALITY OF CONFORMANCE, % 100 


Figure 6.9. New model of optimum quality costs. 
From Juran’s Quality Control Handbook, 4th edition, J.M. Juran and F.M. Gryna, Editors. 
Copyright © 1988, McGraw-Hill. 


mances detected by customers. In addition to the replacement or repair loss, a 
company loses customer goodwill and their reputation is damaged when the 
customer relates his experience to others. In extreme cases, litigation may result, 
adding even more cost and loss of goodwill. 

Another advantage of early detection is that it provides more meaningful 
feedback to help identify root causes. The time lag between production and 
field failure makes it very difficult to trace the occurrence back to the process 
state that produced it. While field failure tracking is useful in prospectively eval- 
uating a “fix,” it is usually of little value in retrospectively evaluating a problem. 


Accounting support 

We have said it before, but it bears repeating, that the support of the account- 
ing department is vital whenever financial and accounting matters are involved. 
In fact, the accounting department bears primary responsibility for accounting 
matters, including cost of quality systems. The Six Sigma department’s role in 
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development and maintenance of the cost of quality system is to provide gui- 
dance and support to the accounting department. 

The cost of quality system must be integrated into the larger cost accounting 
system. It is, in fact, merely a subsystem. Terminology, format, etc., should be 
consistent between the cost of quality system and the larger system. This will 
speed the learning process and reduce confusion. Ideally, the cost of quality 
will be so fully integrated into the cost accounting system that it will not be 
viewed as a separate accounting system at all, it will be a routine part of cost 
reporting and reduction. The ideal cost of quality accounting system will simply 
aggregate quality costs to enhance their visibility to management and facilitate 
efforts to reduce them. For most companies, this task falls under the jurisdiction 
of the controller’s office. 

Quality cost measurement need not be accurate to the penny to be effective. 
The purpose of measuring such costs is to provide broad guidelines for manage- 
ment decision-making and action. The very nature of cost of quality makes 
such accuracy impossible. In some instances it will only be possible to obtain 
periodic rough estimates of such costs as lost customer goodwill, cost of damage 
to the company’s reputation, etc. These estimates can be obtained using special 
audits, statistical sampling, and other market studies. These activities can be 
jointly conducted by teams of marketing, accounting, and Six Sigma personnel. 
Since these costs are often huge, these estimates must be obtained. However, 
they need not be obtained every month. Annual studies are usually sufficient 
to indicate trends in these measures. 


Management of quality costs 

In our discussion of the cost of quality subsystem, we emphasized the impor- 
tance of not creating a unique accounting system. The same holds true when dis- 
cussing management of quality costs. Quality cost management should be part 
of the charter of the senior level cross-functional cost management team. It is 
one part of the broader business effort to control costs. However, in all likeli- 
hood, the business will find that quality cost reduction has greater potential to 
contribute to the bottom line than the reduction of other costs. This is so 
because, unlike other costs, quality costs are waste costs (Pyzdek, 1976). As 
such, quality costs contribute no value to the product or service purchased by 
the customer. Indeed, quality costs are often indicators of negative customer 
value. The customer who brings his car in for a covered warranty expense suf- 
fers uncompensated inconvenience, the cost of which is not captured by most 
quality cost systems (although, as discussed above, we recommend that such 
costs be estimated from time to time). All other costs incurred by the firm pur- 
chase at least some value. 
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Effective cost of quality programs consist of taking the following steps 
(Campanella, 1990, p. 34): 

e Establish a quality cost measurement system 

¢ Develop a suitable long-range trend analysis 

e Establish annual improvement goals for total quality costs 

¢ Develop short-range trend analyses with individual targets which, when 

combined, meet the annual improvement goal 

¢ Monitor progress towards the goals and take action when progress falls 

short of targets 

The tools and techniques described in Chapter 15 are useful for managing Six 
Sigma quality cost reduction projects. 

Quality cost management helps firms establish priorities for corrective 
action. Without such guidance, it is likely that firms will misallocate their 
resources, thereby getting less than optimal return on investment. If such 
experiences are repeated frequently, the organization may even question 
or abandon their quality cost reduction efforts. The most often-used tool 
in setting priorities is Pareto analysis (see Chapter 8). Typically at the out- 
set of the quality cost reduction effort, Pareto analysis is used to evaluate 
failure costs to identify those “vital few” areas in most need of attention. 
Documented failure costs, especially external failure costs, almost certainly 
understate the true cost and they are highly visible to the customer. 
Pareto analysis is combined with other quality tools, such as control charts 
and cause and effect diagrams, to identify the root causes of quality pro- 
blems. Of course, the analyst must constantly keep in mind the fact that 
most costs are hidden. Pareto analysis cannot be effectively performed 
until the hidden costs have been identified. Analyzing only those data 
easiest to obtain is an example of the GIGO (garbage-in, garbage-out) 
approach to analysis. 

After the most significant failure costs have been identified and brought 
under control, appraisal costs are analyzed. Are we spending too much on 
appraisal in view of the lower levels of failure costs? Here quality cost analysis 
must be supplemented with risk analysis to assure that failure and appraisal 
cost levels are in balance. Appraisal cost analysis is also used to justify expen- 
diture in prevention costs. 

Prevention costs of quality are investments in the discovery, incorporation, 
and maintenance of defect prevention disciplines for all operations affecting 
the quality of product or service (Campanella, 1990). As such, prevention 
needs to be applied correctly and not evenly across the board. Much improve- 
ment has been demonstrated through reallocation of prevention effort from 
areas having little effect to areas where it really pays off; once again, the Pareto 
principle in action. 
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Cost of quality examples 
I. Prevention costs—Costs incurred to prevent the occurrence of non- 
conformances in the future, such as* 
A. Marketing/customer/user 
1. Marketing research 
2. Customer/user perception surveys/clinics 
3. Contract/document review 
B. Product/service/design development 
1. Design quality progress reviews 
Design support activities 
Product design qualification test 
Service design qualification 
. Field tests 
C. Purchasing 
1. Supplier reviews 
2. Supplier rating 
3. Purchase order tech data reviews 
4. Supplier quality planning 
D. Operations (manufacturing or service) 
1. Operations process validation 
2. Operations quality planning 
a. Design and development of quality measurement and control 
equipment 


VRWN 


3. Operations support quality planning 

4. Operator quality education 

5. Operator SPC/process control 
E. Quality administration 

1. Administrative salaries 

2. Administrative expenses 

3. Quality program planning 

4. Quality performance reporting 

5. Quality education 

6. Quality improvement 

7. Quality audits 

8. 


Other prevention costs 


*All detailed quality cost descriptions are from Principles of Quality Costs, John T. Hagan, editor. Milwaukee, WI: ASQ 
Quality Press, appendix B. 
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II. Appraisal costs—Costs incurred in measuring and controlling current 
production to assure conformance to requirements, such as 
A. Purchasing appraisal costs 


1. 
2. 
3. 
4, 


Receiving or incoming inspections and tests 
Measurement equipment 

Qualification of supplier product 

Source inspection and control programs 


B. Operations (manufacturing or service) appraisal costs 


1. 


nw EWN 


qi 


Planned operations inspections, tests, audits 
a. Checking labor 

b. Product or service quality audits 

c. Inspection and test materials 

Set-up inspections and tests 

Special tests (manufacturing) 

Process control measurements 
Laboratory support 

Measurement equipment 

a. Depreciation allowances 

b. Measurement equipment expenses 
c. Maintenance and calibration labor 
Outside endorsements and certifications 


C. External appraisal costs 


1. 
2. 
3. 


Field performance evaluation 
Special product evaluations 
Evaluation of field stock and spare parts 


D. Review of tests and inspection data 
E. Miscellaneous quality evaluations 


Ill. Internal failure costs—Costs generated before a product is shipped as a 
result of non-conformance to requirements, such as 
A. Product/service design failure costs (internal) 


1. 
2. 
3. 


Design corrective action 
Rework due to design changes 
Scrap due to design changes 


B. Purchasing failure costs 


1. 


Di. hS 


Purchased material reject disposition costs 
Purchased material replacement costs 
Supplier corrective action 

Rework of supplier rejects 

Uncontrolled material losses 
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C. Operations (product or service) failure costs 
1. Material review and corrective action costs 
a. Disposition costs 
b. Troubleshooting or failure analysis costs (operations) 
c. Investigation support costs 
d. Operations corrective action 
2. Operations rework and repair costs 
a. Rework 
b. Repair 
Reinspection/retest costs 
Extra operations 
Scrap costs (operations) 
Downgraded end product or service 
. Internal failure labor losses 
D. Other internal failure costs 


NAMB w& 


IV. External failure costs—Costs generated after a product is shipped as a 
result of non-conformance to requirements, such as 
A. Complaint investigation/customer or user service 
Returned goods 
Retrofit costs 
Recall costs 
Warranty claims 
Liability costs 
Penalties 
Customer/user goodwill 
Lost sales 
Other external failure costs 


TO Hoe 


Quality cost bases 


The guidelines for selecting a base for analyzing quality costs are: 

e The base should be related to quality costs in a meaningful way 

¢ The base should be well-known to the managers who will receive the qual- 
ity cost reports 

e The base should be a measure of business volume in the area where quality 
cost measurements are to be applied 

e Several bases are often necessary to get a complete picture of the relative 
magnitude of quality costs 

Some commonly used bases are (Campanella, 1990, p. 26): 

¢ A labor base (such as total labor, direct labor, or applied labor) 
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* A cost base (such as shop cost, operating cost, or total material and labor) 

e A sales base (such as net sales billed, or sales value of finished goods) 

¢ A unit base (such as the number of units produced, or the volume of out- 

put) 

While actual dollars spent are usually the best indicator for determining 
where quality improvement projects will have the greatest impact on profits 
and where corrective action should be taken, unless the production rate is rel- 
atively constant, it will not provide a clear indication of quality cost improve- 
ment trends. Since the goal of the cost of quality program is improvement over 
time, it is necessary to adjust the data for other time-related changes such as pro- 
duction rate, inflation, etc. Total quality cost compared to an applicable base 
results in an index which may be plotted and analyzed using control charts, 
run charts, or one of the other tools described in Chapters 11-14. 

For long-range analyses and planning, net sales is the base most often used 
for presentations to top management (Campanella, 1990, p. 24). If sales are rela- 
tively constant over time, the quality cost analysis can be performed for rela- 
tively short spans of time. In other industries this figure must be computed 
over a longer time interval to smooth out large swings in the sales base. For 
example, in industries such as shipbuilding or satellite manufacturing, some 
periods may have no deliveries, while others have large dollar amounts. It is 
important that the quality costs incurred be related to the sales for the same per- 
iod. Consider the sales as the “opportunity” for the quality costs to happen. 

Some examples of cost of quality bases are (Campanella, 1990): 

e Internal failure costs as a percent of total production costs 

e External failure costs as an average percent of net sales 

¢ Procurement appraisal costs as a percent of total purchased material cost 

¢ Operations appraisal costs as a percent of total production costs 

¢ Total quality costs as a percent of production costs 

An example of a cost of quality report that employs some of these bases is 
shown in Figure 6.10. 


Quality cost trend analysis 

As stated above, the purpose of collecting quality cost data is to provide a 
sound basis for taking the necessary action to eliminate the causes of these 
costs, and thereby eliminate the costs themselves. If the action taken is effective, 
the data will indicate a positive trend. Trend analysis is most often performed 
by presenting the data in run chart form and analyzing the runs (see Chapter 
11). It is common to combine all of the cost of quality data on a single graph, as 
shown in Figure 6.11. 
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QUALITY COST SUMMARY REPORT 
FOR THE MONTH ENDING 
(In Thousands of U.S. Dollars) 


CURRENT MONTH YEAR TO DATE 


DESCRIPTION QUALITY AS APERCENT OF QUALITY |4S 4 PERCENT OF 


COSTS | sates | OTHER | COSTS | sates 


1.0 PREVENTION COSTS 


1.1 Marketing/Customer/User 

1.2 Product/Service/Design 
Development 

1.3 Purchasing Prevention Costs 

1.4 Operations Prevention Costs 

1.5 Quality Administration 

1.6 Other Prevention Costs 


TOTAL PREVENTION COSTS 
PREVENTION TARGETS 
APPRAISAL COSTS 


2.1 Purchasing Appraisal Costs 

2.2 Operations Appraisal Costs 

2.3 External Appraisal Costs 

2.4 Review Of Test And 
Inspection Data 

25 Misc. Quality Evaluations 


TOTAL APPRAISAL COSTS 
APPRAISAL TARGETS 
INTERNAL FAILURE COSTS 


3.1 Product/Service Design 
Failure Costs 

3.2 Purchasing Failure Costs 

3.3 Operations Failure Costs 

3.4 Other Internal Failure Costs 


EXTERNAL FAILURE COSTS 
TOTAL FAILURE COSTS 
FAILURE TARGETS 
TOTAL QUALITY COSTS 


BuoceT | acruat | suoceT | acTUAL | BUDGET 


Figure 6.10. Quality costs summary report. 
From Principles of Quality Costs, 2nd Edition, p. 48. Jack Campanella, Editor. 
Copyright © 1990 by ASQ Quality Press. 


BASE DATA 


Net Sales 


Other Base (Specify) 
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Figure 6.11. Cost of quality history. 


If the runs are subjected to the run tests described below, it can be shown that 
the total failure and total COQ (cost of quality) trends are statistically sig- 
nificant. However, for this example data, the use of formal statistical rules is 
superfluous—the improvement is obvious. 

While such aggregate analysis is useful for senior management, it is of little 
value to those engaged in more focused Six Sigma cost of quality projects. In 
these cases the trend data should be as specific as possible to the area being stu- 
died. Also, the measurement may be something more directly related to the 
work being done by the Six Sigma team rather than dollars, and the time interval 
should be shorter. For example, if it has been determined that a major internal 
failure cost item is defective solder joints, then the team should plot a control 
chart of the solder defect rate and analyze the process in real-time. Obviously, 
reducing solder defects should reduce the cost associated with solder defects. 


Implementing the quality cost program 

Quality cost program introduction is a major project and should utilize the 
tools and techniques described in Chapter 15. Prior to implementation, a 
needs analysis should be performed to determine if, in fact, a cost of quality pro- 
gram can benefit the company. The needs assessment should also include a 
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benefit/cost analysis and a plan for the implementation. The plan should 
include: 
e the management presentation, designed to identify the overall opportu- 
nity and show an example of how the program will achieve its benefits 
¢ adescription of the pilot program 
e material designed to educate and involve all functions in the program 
¢ outline of the internal cost of quality accounting procedures 
e description of the data collection and analysis of cost of quality data at the 
highest level of aggregation 
e description of the cost of quality reporting system and how the data will be 
used to improve quality 
As with any major Six Sigma project, a sponsor should be found and manage- 
ment support secured. In the case of cost of quality, the sponsor should be the 
controller or one of her subordinates. 


Use of quality costs 

The principal use of quality cost data is to justify and support quality per- 
formance improvement. Quality cost data help identify problem areas and 
direct resources to these areas. To be effective, the cost of quality system has to 
be integrated with other quality information systems to assure that root causes 
will be addressed. Statistical analysis can be used to correlate quality cost trends 
with other quality data to help direct attention to problem causes. 

One mission of the quality management function is to educate top man- 
agement about the long-range effects of total quality performance on the profits 
and quality reputation of the company. Management must understand that stra- 
tegic planning for quality is as important as strategic planning for any other 
functional area. When the strategic plan addresses cost issues, quality cost con- 
sideration should be prominent. Quality costs should be considered first 
because, since they are waste costs, their reduction is always taken from the 
“fat” of the organization. The role of the quality manager in this process should 
be to (Campanella, 1990, p. 56) 

e analyze major trends in customer satisfaction, defects or error rates, and 
quality costs, both generally and by specific program or project. These 
trends should also be used to provide inputs for setting objectives; 

e assist the other functions to ensure that costs related to quality are 
included in their analyses for setting objectives; 

e develop an overall quality strategic plan which incorporates all functional 
quality objectives and strategic action plans, including plans and budgets 
for the quality function. 
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Benefits of quality cost reduction 

Quality cost reductions can have a significant impact on acompany’s growth 
rate and bottom line. Research done by the Chicago Graduate School of 
Business showed that companies using TQM for an average of 6.5 years 
increased revenues at an annual rate of 8.3% annually, versus 4.2% annually for 
all U.S. manufacturers. Suminski (1994) reports that the average manufacturer’s 
price of non-conformance is 25% of operating costs, for service businesses the 
figure is 35%. These costs represent a direct charge against a company’s profit- 
ability. A New England heavy equipment manufacturer reports that their 
price of non-conformance was 31% of total sales when they undertook a quality 
cost reduction project. In just one year they were able to lower these costs to 
9%. Among their accomplishments: 

¢ Scrap and rework reduced 30%. 

e Manufacturing cost variance reduced 20%. 

e Late collections reduced 46%. 

e Average turnaround on receivables reduced from 62 days to 35 days. 


Lessons learned capture and replication 


It is often possible to apply the lessons learned from a project to other pro- 
cesses, either internally or externally. Most companies have more than one per- 
son or organizational unit performing similar or identical tasks. Many also 
have suppliers and outsourcers who do work similar to that being done intern- 
ally. By replicating the changes done during a project the benefits of Six Sigma 
can be multiplied many fold, often at very minimal cost. Think of it as a form 
of benchmarking. Instead of looking for the best-in-class process for you to 
learn from, the Six Sigma team created a best-in-class process and you want to 
teach the new approach to others. 

Unlike benchmarking, where the seeker of knowledge is predisposed to 
change what they are doing, the process owners who might benefit from the 
knowledge gained during a Six Sigma project may not even be aware that they 
can benefit from a change. This needs to be accounted for when planning the 
program for sharing lessons learned. The process is a combination of motiva- 
tion, education and selling the target audience on the new approach. Chances 
are that those who worked the project are mot the best ones to sell others on 
the new approach. They can serve as technical advisers to those who will carry 
the message to other areas. The Six Sigma function (Process Excellence) usually 
takes the lead in developing a system for replication and sharing of lessons 
learned. 
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In addition to the lessons learned about business processes, a great deal will 
be learned about how to conduct successful projects. In a few years even a mod- 
erately sized Six Sigma effort will complete hundreds or thousands of projects. 
These project lessons learned should be captured and used to help other project 
teams. The information is usually best expressed in simple narratives by the pro- 
ject Black Belt. The narratives can be indexed by search engines and used by 
other Black Belts in the organization. The lessons learned database is an extre- 
mely valuable asset to the Six Sigma organization. 
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Introduction to DMAIC 
and Other Improvement 
Models 


DMAIC, DMADV, AND LEARNING MODELS 


Part II covers the toolkit commonly used in Six Sigma. 


For the most part, these are the same tools used by the quality profession and 
applied statisticians for decades. Six Sigma puts some new twists on these tradi- 


tional tools: 


1. They are taught in the context of a well-defined improvement model 


known as DMAIC (see below). Computers are used intensively. 


2. They are applied at once on real projects designed to deliver tangible 


results for an identified stakeholder. 


3. Items 1 and 2 are integrated via an intensive training regimen that is pro- 
vided to full-time change agents who work on projects while they are 


being trained. 


The tools of Six Sigma are most often applied within a simple performance 
improvement model known as Define-Measure-Analyze-Improve-Control, 
or DMAIC. DMAIC is summarized in Figure 7.1. DMAIC is used when a 
project’s goal can be accomplished by improving an existing product, process, 


or service. 
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INTRODUCTION TO Dmaic 


Figure 7.1. Overview of DMAIC. 


D_ | Define the goals of the improvement activity. The most important 
goals are obtained from customers. At the top level the goals will be 
the strategic objectives of the organization, such as greater customer 
loyalty, a higher ROI or increased market share, or greater employee 
satisfaction. At the operations level, a goal might be to increase the 
throughput of a production department. At the project level goals 
might be to reduce the defect level and increase throughput for a 
particular process. Obtain goals from direct communication with 
customers, shareholders, and employees. 


M | Measure the existing system. Establish valid and reliable metrics to 
help monitor progress towards the goal(s) defined at the previous 
step. 


A | Analyze the system to identify ways to eliminate the gap between the 
current performance of the system or process and the desired goal. 
Begin by determining the current baseline. Use exploratory and 
descriptive data analysis to help you understand the data. Use 
statistical tools to guide the analysis. 


I Improve the system. Be creative in finding new ways to do things 
better, cheaper, or faster. Use project management and other 
planning and management tools to implement the new approach. Use 
statistical methods to validate the improvement. 


C_ | Control the new system. Institutionalize the improved system by 
modifying compensation and incentive systems, policies, procedures, 
MRP, budgets, operating instructions and other management 
systems. You may wish to utilize standardization such as ISO 9000 to 
assure that documentation is correct. Use statistical tools to monitor 
stability of the new systems. 


DMAIC is such an integral part of Six Sigma that it is used to organize the 
material for Part II of this book. It provides a useful framework for conducting 
Six Sigma projects, see Figure 7.2. DMAIC is sometimes even used to create a 
“gated process” for project control. That is, criteria for completing a particular 
phase are defined and projects reviewed to determine if all of the criteria have 
been met. If so, then the gate (e.g., Define) is “closed.” 


DMAIC, DMADV, and learning models 239 


What is the business case for the 
project? 
Identify the customer 


i Current state map 
Future state map 

What is the scope of this project? 
| Deliverables 

Due date 


Control 
Q During the project, how will I control 


Measure 


risk, quality, cost, schedule, scope, 
and changes to the plan? 

Q What types of progress reports should 
I create? 

Q How will I assure that the business 


Q~ What are the key metrics for this 


business process? 

Are metrics valid and reliable? 
Do we have adequate data on this 
process? 


Q How will I measure progress? 


goals of the project were t é 
Q = How will I measure project success? 


accomplished? 
Q How will I keep the gains made? 


Analyze 


Q = Current state analysis 
Q_ Is the current state as good as the 


Improve process can do? 
Q > What is the work breakdown Q Who will help make the changes? 
structure? Q Resource requirements 
Q What could cause this change effort to 


Q What specific activities are necessary 
to meet the project's goals? 

Q How will I re-integrate the various 
subprojects? 


fail? 
Q What major obstacles do I face in 
completing this project? 


Figure 7.2. Using DMAIC ona Six Sigma project. 


Table 7.1 shows a partial listing of tools often found to be useful in a given 
stage of a project. There is considerable overlap in practice. 


Design for Six Sigma project framework 
Another approach, used when the goal is the development of a new or radi- 
cally redesigned product, process or service, is Define-Measure-Analyze- 
Design-Verify, or DMADV (Figure 7.3). DMADV is part of the design for Six 
Sigma (DFSS) toolkit. 
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Table 7.1. Six Sigma tools commonly used in each phase of a project. 


Project Phase Candidate Six Sigma Tools 


Define Project charter 


VOC tools (surveys, focus groups, letters, comment 
cards) 

Process map 

QED, SIPOC 


Benchmarking 


Measure Measurement systems analysis 


Exploratory data analysis 


Descriptive statistics 


Data mining 


Run charts 


Pareto analysis 


Analyze Cause-and-effect diagrams 


Tree diagrams 


Brainstorming 
Process behavior charts (SPC) 
Process maps 


Design of experiments 


Enumerative statistics (hypothesis tests) 
Inferential statistics (Xs and Ys) 
FMEA 


Simulation 


Improve Force field diagrams 
7M tools 
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Define the goals of the design activity. What is being designed? 
Why? Use QFD or the Analytic Hierarchical Process to assure that 


D p 2 ; 
the goals are consistent with customer demands and enterprise 
strategy. 

M Measure. Determine Critical to Stakeholder metrics. Translate 
customer requirements into project goals. 

ie Analyze the options available for meeting the goals. Determine the 


performance of similar best-in-class designs. 


Design the new product, service or process. Use predictive models, 
D_ | simulation, prototypes, pilot runs, etc. to validate the design 
concept’s effectiveness in meeting goals. 


V_ | Verify the design’s effectiveness in the real world. 


Figure 7.3. Overview of DMADV. 


Figure 7.4 illustrates the relationship between DMAIC and DMADV. 


Learning models 


Knowledge is hierarchical, meaning that some ideas have more impact 
than others because they are more fundamental. Six Sigma tends to take a 
very “practical view” of the world, but this perspective is dangerous if its 
context isn’t well understood. True, the focus is on doing. But how do we 
know that what we are doing is correct? If we are wrong, then our actions 
may make matters worse instead of better. The question of how we know 
that we know is a philosophical one, not a technical one. Technical tools, 
such as statistical methods, can be used to help us answer this question, 
but unless we have a deep understanding of the philosophy that underlies 
the use of the tools we won’t really know how to interpret the results 
obtained. 

Learning is the acquisition of new knowledge about the way the world 
works. Both DMAIC and DMADV are learning frameworks. Learning 
must occur if the project deliverable is to provide the intended benefit. 
Without learning to guide process change activity it’s just hit-and-miss, and 
Murphy’s Law* assures that our efforts will miss the mark more often than 
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DMAIC versus DMADV 
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Figure 7.4. DMAIC and DMADV. 


not. There is a long and proud history of learning models that reflect the 
thinking of some of the greatest minds in twentieth century business, such as 
Drs. Shewhart, Deming and Juran. There are new learning models that incor- 
porate recent discoveries in the fields of chaos theory and complexity theory. 
The new models, Select-Experiment-Learn (SEL) and Select-Experiment- 
Adapt (SEA), apply to systems in dynamic, far from equilibrium environ- 
ments where the traditional models break down. 


* Anything that can go wrong, will. 
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PDCA (PLAN-DO-CHECK-ACT) 

The PDCA cycle, which Deming refers to as the PDSA cycle (Deming, 1993, 
p. 134), is a flow chart for learning and process improvement. The basic idea 
began with Shewhart’s attempt to understand the nature of knowledge. 
Shewhart believed that knowledge begins and ends in experimental data but 
that it does not end in the data in which it begins. He felt there were three impor- 
tant components of knowledge (Shewhart, 1939, 1986): a) the data of experience 
in which the process of knowing begins, b) the prediction in terms of data that 
one would expect to get if one were to perform certain experiments in the future, 
and c) the degree of belief in the prediction based on the original data or some 
summary thereof as evidence. Shewhart arranged these three components sche- 
matically as shown in Figure 7.5. 


ORIGINAL DATA 
———> 
AS EVIDENCE PREDICTION 


DEGREE OF BELIEF IN PREDICTION 
BASED ON THE EVIDENCE 


Figure 7.5. The three components of knowledge. 


Since knowledge begins with the original data and ends in new data, these 
future data constitute the operationally verifiable meaning of the original data. 
However, since inferences or predictions based upon experimental data can 
never be certain, the knowledge based upon the original data can inhere in 
these data only to the extent of some degree of rational belief. In other words, 
according to Shewhart, knowledge can only be probable. Also, the data are not 
“facts” in and of themselves, they are merely measurements that allow us to 
draw inferences about something. In other words, we can not have facts without 
some theory. 

Shewhart applied these principles in many practical ways. For example, he 
identified the three steps of quality control in manufacturing as specification, 
production, and judgment of quality (inspection). He noted that, in practice, 
specifications could not be set without first having some information from 
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Figure 7.6. Scientific process of acquiring knowledge. 


inspection to help establish process capability, and that this information could 
not be obtained until some units had been produced. In short, Shewhart modi- 
fied the sequence of specification-production-inspection as shown in Figure 
7.6. He also observed that the specification-production-inspection sequence cor- 
responded respectively to making a hypothesis, carrying out an experiment, 
and testing the hypothesis. Together the three steps constitute a dynamic scien- 
tific process of acquiring knowledge. 

Note that Shewhart’s model of knowledge forms a circle. Shewhart 
followed the teachings of philosopher C.I. Lewis, who believed that all good 
logics are circular. The essence of this view is to see knowledge as dynamic. 
It changes as new evidence comes in. As Shewhart put it (Shewhart, 1939, 
1986, p. 104): 


Knowing in this sense is somewhat a continuing process, or method, and 
differs fundamentally in this respect from what it would be if it were poss- 
ible to attain certainty in the making of predictions. 


Shewhart and Deming revised the above model for application to the 
improvement of products and processes. The new model was first called the 
PDCA cycle, later revised by Deming to the Plan-Do-Study-Act, or PDSA 
cycle (Deming, 1993, p. 134). The Shewhart-Deming PDSA cycle is shown in 
Figure 7.7. 
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Figure 7.7. The Shewhart-Deming PDSA cycle for learning and improvement. 


Plan a change or a test, aimed at improvement. This is the foundation for the 
entire PDCA-PDSA cycle. The term “plan” need not be limited to large-scale 
planning on an organization-wide scale, it may simply refer to a small process 
change one is interested in exploring. 

Do. Carry out the change or the test (preferably on a small scale). It is impor- 
tant that the DO step carefully follow the plan, otherwise learning will not be 
possible. 

Study the results. What did we learn? What went wrong? 

Act. Adopt the change, or abandon it, or run through the cycle again. 

The PDCA approach is essentially a management-oriented version of the ori- 
ginal Shewhart cycle, which focused on engineering and production. A number 
of other variations have been developed, two of Deming’s variations are shown 
in Figure 7.8. 

Juran depicts quality as a “spiral,” as shown in Figure 7.9. 

Because of their historical origins and logical appeal, circular diagrams are 
ubiquitous in the quality field. In quality management, the circle represents con- 
tinuous improvement of quality by continuous acquisition of knowledge. 


DYNAMIC MODELS OF LEARNING AND 
ADAPTATION 


The PDSA cycle describes planning and learning in an environment at or 
near a stable equilibrium. The PDSA loop indicates that plans are con- 
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Figure 7.8. Some variations of the PDCA-PDSA cycle. 


tinuously improved by studying the results obtained when the plans are 
implemented, and then modifying the plans. However, the PDSA model fails 
to account for the activities of other agents, which is a characteristic of com- 
plex adaptive systems, such as a market economy. For this situation I propose 
a new model, the Select-Experiment-Adapt (SEA) model depicted in Figure 
7A, 
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Figure 7.9. Juran’s spiral of progress in quality. 


In real life, experimentation goes on constantly. Experimenting involves 
executing a performance rule activated by a message received from the envi- 
ronment. We observe something, or induce something based on thinking 
about past observations, and decide which course of action would be most 
beneficial. The action taken in response to the environmental messages is 
called a performance rule. Adaptation occurs by adjusting the strength of the 
performance rule based on the payoff we actually received from it. Repeated 
iterations of the SEA cycle mimics what computer scientist John Holland 
calls the bucket brigade algorithm (Holland, 1996) which strengthens rules 
that belong to chains of action terminating in rewards. The process amounts 
to a progressive confirmation of hypotheses concerned with stage setting and 
subgoals. 


> Adapt > Select Adapt —--—————>- Select Adapt ————————>- Select 


Customer a 4 = Competitor Y 
Experiment Experiment 


Figure 7.10. The Select-Experiment-Adapt (SEA) model for non-linear systems. 
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SEA versus PDSA 


In the PDSA cycle, the plan documents the theory being tested. Deming 
believed that a statement which conveys knowledge must predict future out- 
comes, with risk of being wrong, and that it fits without failure observations of 
the past. Rational prediction, according to Deming, requires theory and builds 
knowledge through systematic revision and extension of theory based on com- 
parison of prediction with observation. Without theory there is nothing to 
revise, so experience has no meaning (Deming, 1993). 

The SEA model, unlike the PDSA cycle, contains positive feedback loops, 
making this a dynamic, non-linear system. These systems act like both common 
and special causes in the Shewhart-Deming model. Virtually undetectable 
minor differences (common causes) are greatly amplified by positive feedback 
and produce unpredictably large effects (special causes). Because of positive 
feedback the behavior of even simple systems like the one shown in Figure 7.10 
is unpredictable, even in principle. Of course, this illustration grossly oversim- 
plifies reality. In the real world there are many competitors, competitors for 
our customers, many customers, regulation, many employees changing things 
in our firm, and so on. But the conclusion is the same: long-term forecasting is 
impossible, and therefore long-term planning is invalid. The “P” (plan) in the 
PDSA cycle cannot be used for other than short-term planning or systems in a 
state of “control” in the Shewhart-Deming sense. 

The “S” (study) element is also suspect. What exactly are we studying? The 
effect of the action we took in the “A” (act) step? This won’t work because the 
observed effects are also influenced, even overwhelmed, by actions taken by 
other agents. Thus, we may falsely conclude that our actions had an effect when 
in fact they did not, leading to superstitious learning. For example, we run a spe- 
cial promotion and sales increase, leading us to conclude that the promotion 
was a success. But in fact our promotion just happened to coincide with a cus- 
tomer promotion that created a temporary increase in demand for our product. 

Or we may conclude that our actions did not have an effect when in fact their 
effect was masked by activities by other agents. For example, perhaps our new 
marketing program would have worked except that our competitor had a 
short-term sale and our customer was under pressure to hold costs down due 
to a temporary cash flow problem. 


Learning and the SEA model 

In the SEA model, there is no “learning” per se. There is merely strategic 
adaptation. Computers can be programmed to modify performance rules 
based on payoffs, but the computer doesn’t learn anything. It merely “discov- 
ers” new performance rules through successful adaptations based on repeated 
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trial and error, ie., through iterations of the SEA loop. Learning in the human 
sense involves discovering principles that explain the reasons for the increased 
or decreased payoffs obtained by applying the performance rules. This is a dif- 
ferent thing entirely than simply discovering that a particular performance 
rule gives a somewhat higher payoff. Learning makes it possible to skip one or 
more generations of adaptation. 

One model that incorporates learning in a dynamic environment, the Select- 
Experiment-Learn (SEL) model, is shown in Figure 7.11. 


| 
Learn —————————- Select Learn —————————- Select Learn —————————. Select 
eae Firm Y ee Customer yY aaa Competitor Y 


Experiment 


Experiment Experiment 


Figure 7.11. The Select-Experiment-Learn (SEL) model for dynamic systems. 


SEL also differs from PDSA. Shewhart realized the value of discovering sci- 
entific principles, and he also understood that progress was possible even with- 
out this knowledge. However, Shewhart believed that it was possible to apply 
natural laws to achieve “control within limits,” ie., statistical certainty. What 
Shewhart called a state of statistical control, I will call statistical equilibrium. 
A system exhibits statistical equilibrium when its future performance is predict- 
able within limits which can be determined using linear, negative feedback mod- 
els. Chaos theory and complexity theory show that in dynamic environments, 
ie., environments influenced by positive feedback, even this level of control is 
impossible to achieve. 

The SEL model is designed for a dynamic environmentand it does not attempt 
to develop long-range strategic plans based on super-human knowledge and fore- 
sight. Instead SEL seeks principles that are useful for making predictions, recog- 
nizing that positive feedback and the actions of other agents makes it difficult to 
identify the effects of these principles. Furthermore, other agents may also 
acquire this knowledge and modify their behavior, thereby negating the principle. 
For example, cooperation and reciprocity may appear to be a principle that 
applies to all human cultures. However, since the principle applies to agents, 
future behavior can not be predicted with even statistical certainty. If others rea- 
lize that you are applying this principle, they can take advantage of your predict- 
ability. Of course, until new breakthrough principles are learned, gradual 
continuous improvement can still be obtained by using the SEA model. The 
cumulative improvement from SEA can be significant (e.g., natural evolution). 
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Essentially, when environments are dynamic the SEA and SEL models 
replace the equilibrium environment PDSA learning model with dynamic adap- 
tation (SEA) and agent-based learning (SEL). Centralized control schemes 
(plans) are replaced by self-control or at least local control by meta-agents. Six 
Sigma activities should employ all three strategies for improvement. Here are 
some general guidelines to help you determine when to apply a given approach: 

e SEA applies unless formal, controlled experiments are underway. Follow 
a mini-max strategy: minimize central planning and control to the maxi- 
mum extent possible. Allow individual employees maximum freedom to 
experiment and change their work environment and processes to seek bet- 
ter ways to do things. 

e¢ When processes are influenced by positive feedback from other agents, 
apply the SEA and SEL models. Eliminate long-term strategic planning 
and strive to cultivate an environment with maximum ability to adapt to 
change. 

e When processes are at or near equilibrium and not influenced by positive 
feedback loops, PDSA applies. Since PDSA is planning based, the use of 
formal teams is justified. Rigorously apply the tools of process control, 
formal design of experiments, etc. 


Illustration of PDSA, SEA and SEL 

The chart below shows the percentage change in the S and P 500 index of 
stocks over a period of 100 months. The data reflect the buying and selling activ- 
ities of millions of investors. The data reflect statistical control, i.e., equilibrium 
behavior, for the entire period and PDSA functioned quite well for investors 
during the period. Using control charts the predicted return for the next 
month is between —11.2% and +12.6%. 
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But this process turned out to be distinctly non-linear. In the month #101, 
investors (agents) reacted to a price drop by selling, which caused the price to 
drop further, which caused still more selling. In other words, this dynamic pro- 
cess encountered a positive feedback loop. The result of this SEA behavior: a 
drop of nearly 22% (indicated by an “X”’ on the chart); a far greater drop than 
predicted by linear statistical models. 

Some investors were not influenced by the positive feedback. Using SEL 
logic, they examined macro and micro factors and found no reason for the 
plunge. Rather than selling, they either held on to their shares or bought more. 
For a while, it appeared that this strategy would backfire: the market dropped 
another 9% the next month. But it eventually recovered, regained all of the lost 
ground, and moved back into positive territory. 
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CHAPTER 


Problem Solving Tools 


PROCESS MAPPING 


Just as companies have organization charts, they can have process maps that 
give a picture of how work flows through the company. A process map creates 
a vocabulary to help people discuss process improvement. A process map is a 
graphic representation of a process, showing the sequence of tasks using a mod- 
ified version of standard flowcharting symbols. The map of a work process is a 
picture of how people do their work. Work process maps are similar to road 
maps in that there are many alternative routes that will accomplish the objec- 
tive. In any given circumstance, one route may be better than others. By creating 
a process map, the various alternatives are displayed and effective planning is 
facilitated. The steps involved are as follows (Galloway, 1994): 

1. Select a process to be mapped. 

Define the process. 

Map the primary process. 

Map alternative paths. 

Map inspection points. 

Use the map to improve the process. 

Process correspond to natural business activities. However, in modern 
organizations these natural processes are fragmented among many different 
departments. A process map provides an integrated picture of the natural pro- 
cess. Because of the focus on organizational hierarchies, processes tend to be 
unmanaged. People are responsible for departments and budgets, but no one is 
responsible for the processes. 
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Because organizations are arranged as departments rather than processes, it 
is often difficult for people to see the processes that make up the business. To 
get a better handle on the processes that make up a business, Hammer and 
Champy (1993, p. 118) suggest that they be given names that express their begin- 
ning and ending states. These names should imply all the work that gets done 
between their start and finish. Manufacturing, which sounds like a department 
name, is better called the procurement-to-shipment process. Some other recur- 
ring processes and their state-change names: 
¢ Product development: concept to prototype 
¢ Sales: prospect to order 

Order fulfillment: order to payment 

e Service: inquiry to resolution 


Cycle time reduction through cross-functional 


process mapping 

Hurley and Loew (1996) describe how Motorola uses process mapping to 
help them reduce cycle times. Cross-functional process mapping involves cre- 
ating teams whose members are selected from every department involved in 
the new product development cycle—from marketing to manufacturing to 
research and development. The next phase involves mapping each step within 
the product development process from start to finish. Team members are 
divided into four categories: 

¢ Project champion—provide resources and remove barriers 

e Team leader—organize and conduct meetings, insure that information 

exchange occurs 

e Action item owner—complete assigned tasks 

¢ Team member—complete assigned tasks 

The teams develop two maps: an “as-is” map and a “should-be” map. The 
As-is may detail the way the new product-development process is currently 
run and identifies all the problematic issues that exist in the current way that 
new product development is accomplished. Using the cross-functional format, 
each step of the process is mapped out, along with the time each step takes. 
The result of the exercise is twofold: a map that shows the current process, and 
an appreciation among team members of the contributions of their fellow 
team members. The As-is map can be used to improve the current process 
(KAIZEN). If possible, any steps that do not add value in the customer’s eyes, 
or that are redundant, should be deleted. 

The Should-be map forms the basis of reengineering the product develop- 
ment process. The Should-be map details each step in the new, more efficient 
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process. A list of action items is created during this mapping session. Action 
items define and detail what needs to be changed in order to move from the 
As-is state to the Should-be state. The project management tools and techniques 
described in Chapter 15 are then used to plan and implement the necessary 
steps. A Should-be process map is shown in Figure 8.1. 
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Figure 8.1. New product/service development “should-be” process map. 
From Hurley, H. and Loew, C. (1996), “A quality change for new product development,” 
The Quality Observer, January, pp. 10-13. 


FLOW CHARTS 


A process flow chart is simply a tool that graphically shows the inputs, 

actions, and outputs of a given system. These terms are defined as follows: 

Inputs—the factors of production: land, materials, labor, equipment, and 
management. 

Actions—the way in which the inputs are combined and manipulated in 
order to add value. Actions include procedures, handling, storage, 
transportation, and processing. 

Outputs—the products or services created by acting on the inputs. Outputs 
are delivered to the customer or other user. Outputs also include 
unplanned and undesirable results, such as scrap, rework, pollution, 
etc. Flow charts should contain these outputs as well. 
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Flow charting is such a useful activity that the symbols have been stan- 
dardized by various ANSI standards. There are special symbols for special pro- 
cesses, such as electronics or information systems. However, in most cases one 
can get by with the symbols shown in Figure 8.2. 


D "D" Shaped symbol 
RECTANGLE represents represents delay. 
a process step. 
> HEXAGON symbol represents set up 
or preparation activity. 
DIAMOND represents a decision branch. 
The next activity to be performed depends CIRCLE shows that the flowchart is 
on the outcome of this decision. continued at (or from) another 


flow chart with a matching circle letter. 


Figure 8.2. Selected flow chart symbols. 


The flow chart in Figure 8.3 shows a high-level view of a process capability 
analysis. The flow chart can be made either more complex or less complex. As 
a rule of thumb, to paraphrase Albert Einstein, “Flow charts should be as simple 
as possible, but not simpler.” The purpose of the flow chart is to help people 
understand the process and this is not accomplished with flow charts that are 
either too simple or too complex. 


CHECK SHEETS 


Check sheets are devices which consist of lists of items and some indicator of 
how often each item on the list occurs. In their simplest form, checklists are 
tools that make the data collection process easier by providing pre-written 
descriptions of events likely to occur. A well-designed check sheet will answer 
the questions posed by the investigator. Some examples of questions are: “Has 
everything been done?” “Have all inspections been performed?” “How often 
does a particular problem occur?” “Are problems more common with part X 
than with part Y?” They also serve as reminders that direct the attention of the 
data collector to items of interest and importance. Such simple check sheets 
are called confirmation check sheets. Check sheets have been improved by add- 
ing a number of enhancements, a few of which are described below 

Although they are simple, check sheets are extremely useful process- 
improvement and problem-solving tools. Their power is greatly enhanced 
when they are used in conjunction with other simple tools, such as histograms 
and Pareto analysis. Ishikawa (1985) estimated that 80% to 90% of all workplace 
problems could be solved using only the simple quality improvement tools. 
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Figure 8.3. Flow chart of process capability analysis. 
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Process check sheets 


These check sheets are used to create frequency distribution tally sheets that 
are, in turn, used to construct histograms (see below). A process check sheet is 
constructed by listing several ranges of measurement values and recording a 
mark for the actual observations. An example is shown in Figure 8.4. Notice 
that if reasonable care is taken in recording tick marks, the check sheet gives a 
graphical picture similar to a histogram. 
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RANGE OF MEASUREMENTS FREQUENCY 
0.990-0.995 INCHES ///1 
0.996-1.000 INCHES MY 
1.001-1.005 INCHES ML 1/1) 
1.006-1.010 INCHES ML PAE // 
1.011-1.015 INCHES //// 
1.016-1.020 INCHES // 


Figure 8.4. Process check sheet. 


Defect check sheets 
Here the different types of defects are listed and the observed frequencies 
recorded. An example of a defect check sheet is shown in Figure 8.5. If reasonable 
care is taken in recording tick marks, the check sheet resembles a bar chart. 


Stratified defect check sheets 
These check sheets stratify a particular defect type according to logical cri- 
teria. This is helpful when the defect check sheet fails to provide adequate infor- 
mation regarding the root cause or causes of a problem. An example is shown 


in Figure 8.6. 


eee FREQUENCY 
COLD SOLDER //// 
NO SOLDER IN HOLE MAL PAE 1/1 
GRAINY SOLDER KL 1/1) 
HOLE NOT PLATED THROUGH PHL MAKE /// 
MASK NOT PROPERLY INSTALLED | A/ //// 
PAD LIFTED / 


Figure 8.5. Defect check sheet. 
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Figure 8.6. Stratified defect check sheet. 


Defect location check sheets 
These “check sheets” are actually drawings, photographs, layout diagrams or 
maps which show where a particular problem occurs. The spatial location is 
valuable in identifying root causes and planning corrective action. In Figure 
8.7, the location of complaints from customers about lamination problems on 
a running shoe are shown with an “X.” The diagram makes it easy to identify a 
problem area that would be difficult to depict otherwise. In this case, a picture 


is truly worth a thousand words of explanation. 


Figure 8.7. Defect location check sheet lamination complaints. 
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Cause and effect diagram check sheets 


Cause and effect diagrams can also serve as check sheets. Once the diagram 
has been prepared, it is posted in the work area and the appropriate arrow is 
marked whenever that particular cause or situation occurs. Teams can also use 
this approach for historic data, when such data are available. 


PARETO ANALYSIS 


Definition—Pareto analysis is the process of ranking opportunities to 
determine which of many potential opportunities should be pursued 
first. It is also known as “separating the vital few from the trivial many.” 

Usage—Pareto analysis should be used at various stages in a quality 
improvement program to determine which step to take next. Pareto 
analysis is used to answer such questions as “What department should 
have the next SPC team?” or “On what type of defect should we con- 
centrate our efforts?” 


How to perform a Pareto analysis 

1. Determine the classifications (Pareto categories) for the graph. If the 
desired information does not exist, obtain it by designing check sheets 
and log sheets. 

2. Select a time interval for analysis. The interval should be long enough to 
be representative of typical performance. 

3. Determine the total occurrences (i.e., cost, defect counts, etc.) for each 
category. Also determine the grand total. If there are several categories 
which account for only a small part of the total, group these into a cat- 
egory called “other.” 

4. Compute the percentage for each category by dividing the category 
total by the grand total and multiplying by 100. 

5. Rank-order the categories from the largest total occurrences to the 
smallest. 

6. Compute the “cumulative percentage” by adding the percentage for 
each category to that of any preceding categories. 

7. Construct a chart with the left vertical axis scaled from 0 to at least the 
grand total. Put an appropriate label on the axis. Scale the right vertical 
axis from 0 to 100%, with 100% on the right side being the same height 
as the grand total on the left side. 

8. Label the horizontal axis with the category names. The left-most cate- 
gory should be the largest, second largest next, and so on. 
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10. 


Draw in bars representing the amount of each category. The height of 
the bar is determined by the left vertical axis. 

Draw a line that shows the cumulative percentage column of the Pareto 
analysis table. The cumulative percentage line is determined by the 
right vertical axis. 


Example of Pareto analysis 
The data in Table 8.1 have been recorded for peaches arriving at Super Duper 


Market during August. 
Table 8.1. Raw data for Pareto analysis. 
PROBLEM PEACHES LOST 
Bruised 100 
Undersized 87 
Rotten 235 
Underripe 9 
Wrong variety 7 
Wormy 3 


The Pareto table for the data in Table 8.1 is shown in Table 8.2. 


Table 8.2. Data organized for Pareto analysis. 


CATEGORY | COUNT | PERCENTAGE 


2 Bruised 100 22.68 75.97 
3 Undersized 87 19.73 95.70 
4 Other 19 4.31 100.01 
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Note that, as often happens, the final percentage is slightly different than 
100%. This is due to round-off error and is nothing to worry about. The finished 
diagram is shown in Figure 8.8. 
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Figure 8.8. The completed Pareto diagram. 


CAUSE AND EFFECT DIAGRAMS 


Process improvement involves taking action on the causes of variation. With 
most practical applications, the number of possible causes for any given pro- 
blem can be huge. Dr. Kaoru Ishikawa developed a simple method of graphically 
displaying the causes of any given quality problem. His method is called by sev- 
eral names, the Ishikawa diagram, the fishbone diagram, and the cause and 
effect diagram. 

Cause and effect diagrams are tools that are used to organize and graphically 
display all of the knowledge a group has relating to a particular problem. 
Usually, the steps are: 

1. Develop a flow chart of the area to be improved. 

2. Define the problem to be solved. 

3. Brainstorm to find all possible causes of the problem. 
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4. Organize the brainstorming results in rational categories. 

5. Construct a cause and effect diagram that accurately displays the rela- 
tionships of all the data in each category. 

Once these steps are complete, constructing the cause and effect diagram is 

very simple. The steps are: 

1. Drawa box on the far right-hand side of a large sheet of paper and draw a 
horizontal arrow that points to the box. Inside of the box, write the 
description of the problem you are trying to solve. 

2. Write the names of the categories above and below the horizontal line. 
Think of these as branches from the main trunk of the tree. 

3. Draw in the detailed cause data for each category. Think of these as limbs 
and twigs on the branches. 

A good cause and effect diagram will have many “twigs,” as shown in Figure 
8.9. If your cause and effect diagram doesn’t have a lot of smaller branches and 
twigs, it shows that the understanding of the problem is superficial. Chances 
are you need the help of someone outside of your group to aid in the under- 
standing, perhaps someone more closely associated with the problem. 

Cause and effect diagrams come in several basic types. The dispersion analy- 
sis type is created by repeatedly asking “why does this dispersion occur?” For 
example, we might want to know why all of our fresh peaches don’t have the 
same color. 

The production process class cause and effect diagram uses production pro- 
cesses as the main categories, or branches, of the diagram. The processes are 
shown joined by the horizontal line. Figure 8.10 is an example of this type of dia- 
gram. 

The cause enumeration cause and effect diagram simply displays all possible 
causes of a given problem grouped according to rational categories. This type 
of cause and effect diagram lends itself readily to the brainstorming approach 
we are using. 

Cause and effect diagrams have a number of uses. Creating the diagram is an 
education in itself. Organizing the knowledge of the group serves as a guide for 
discussion and frequently inspires more ideas. The cause and effect diagram, 
once created, acts as a record of your research. Simply record your tests and 
results as you proceed. If the true cause is found to be something that wasn’t 
on the original diagram, write it in. Finally, the cause and effect diagram is a dis- 
play of your current level of understanding. It shows the existing level of tech- 
nology as understood by the team. It is a good idea to post the cause and effect 
diagram in a prominent location for all to see. 

A variation of the basic cause and effect diagram, developed by Dr. Ryuji 
Fukuda of Japan, is cause and effect diagrams with the addition of cards, or 
CEDAC. The main difference is that the group gathers ideas outside of the 
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Figure 8.10. Production process class cause and effect diagram. 


meeting room on small cards, as well as in group meetings. The cards also serve 
as a vehicle for gathering input from people who are not in the group; they can 
be distributed to anyone involved with the process. Often the cards provide 
more information than the brief entries on a standard cause and effect diagram. 
The cause and effect diagram is built by actually placing the cards on the 
branches. 


7M TOOLS 


Since Dr. Shewhart launched modern quality control practice in 1931, the 
pace of change in recent years has been accelerating. The 7M tools are an exam- 
ple of the rapidly changing face of quality technology. While the traditional 
QC tools (Pareto analysis, control charts, etc.) are used in the analysis of quanti- 
tative data, the 7M tools apply to qualitative data as well. The “M” stands for 
Management, and the tools are focused on managing and planning quality 
improvement activities. In recognition of the planning emphasis, these tools 
are often referred to as the “7 MP” tools. This section will provide definitions 
of the 7M tools. The reader is referred to Mizuno (1988) for additional informa- 
tion on each of these techniques. 


Affinity diagrams 


The word affinity means a “natural attraction” or kinship. The affinity dia- 
gram is a means of organizing ideas into meaningful categories by recognizing 
their underlying similarity. It is a means of data reduction in that it organizes a 
large number of qualitative inputs into a smaller number of major dimensions, 
constructs, or categories. The basic idea is that, while there are many variables, 
the variables are measuring a smaller number of important factors. For example, 
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if patients are interviewed about their hospital experience they may say “the 
doctor was friendly,” “the doctor knew what she was doing,” and “the doctor 
kept me informed.” Each of these statements relates to a single thing, the doctor. 
Many times affinity diagrams are constructed using existing data, such as 
memos, drawings, surveys, letters, and so on. Ideas are sometimes generated in 
brainstorming sessions by teams. The technique works as follows: 

1. Write the ideas on small pieces of paper (Post-its'™ or 3 x 5 cards work 
very well). 

2. The team works in silence to arrange the ideas into separate categories. 
Silence is believed to help because the task involves pattern recognition 
and some research shows that for some people, particularly males, lan- 
guage processing involves the left side of the brain. Research also shows 
that left-brain thinking tends to be more linear, which is thought to inhi- 
bit creativity and pattern recognition. Thus, by working silently, the 
right brain is more involved in the task. To put an idea into a category a 
person simply picks up the Post-it’ and moves it. 

3. The final groupings are then reviewed and discussed by the team. 
Usually, the grouping of ideas helps the team to develop a coherent plan. 

Affinity diagrams are useful for analysis of quality problems, defect data, cus- 

tomer complaints, survey results, etc. They can be used in conjunction with 
other techniques such as cause and effect diagrams or interrelationship digraphs 
(see below). Figure 8.11 is an example of an affinity diagram. 


Tree diagrams 

Tree diagrams are used to break down or stratify ideas in progressively 
greater detail. The objective is to partition a big idea or problem into its smaller 
components. By doing this you will make the idea easier to understand, or the 
problem easier to solve. The basic idea behind this is that, at some level, a pro- 
blem’s solution becomes relatively easy to find. Figure 8.12 shows an example 
of a tree diagram. Quality improvement would progress from the right-most 
portion of the tree diagram to the left-most. Another common usage of tree dia- 
grams is to show the goal or objective on the left side and the means of accom- 
plishing the goal, to the right. 


Process decision program charts 
The process decision program chart (PDPC) is a technique designed to help 
prepare contingency plans. It is modeled after reliability engineering methods 
of failure mode, effects, and criticality analysis (FMECA) and fault tree analysis 
(see Chapter 16). The emphasis of PDPC is the impact of the “failures” (pro- 
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Figure 8.11. Software development process affinity diagram. 
From “Modern approaches to software quality improvement,’ figure 3, 
Australian Organization for Quality: Qualcon 90. Copyright © 1990 by 


Thomas Pyzdek. 
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Circuit Storage 
Board { 
Contaminated “Handling 
No Solderability 
Solder Components ~+—-Contaminated 
in Hole Installation 


Plug Installation 
Masking —, 
Tape Installation 
Figure 8.12. An example of a tree diagram. 


blems) on project schedules. Also, PDPC seeks to describe specific actions to be 
taken to prevent the problems from occurring in the first place, and to mitigate 
the impact of the problems if they do occur. An enhancement to classical 
PDPC is to assign subjective probabilities to the various problems and to use 
these to help assign priorities. Figure 8.13 shows a PDPC. 
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Figure 8.13. Process decision program chart. 
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Matrix diagrams 

A matrix diagram is constructed to analyze the correlations between two 
groups of ideas. Actually, quality function deployment (QFD) is an enhanced 
matrix diagram (see Chapter 3 for a discussion of QFD). The major advantage 
of constructing matrix diagrams is that it forces you to systematically analyze 
correlations. Matrix diagrams can be used in conjunction with decision trees. 
To do this, simply use the most detailed level of two decision trees as the con- 
tents of rows and columns of a matrix diagram. An example of a matrix diagram 
is shown in Figure 8.14. 
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Figure 8.14. An example of a matrix diagram. 


Interrelationship digraphs 
Like affinity diagrams, interrelationship digraphs are designed as a means of 
organizing disparate ideas, usually (but not always) ideas generated in brain- 
storming sessions. However, while affinity diagrams seek to simply arrange 
related ideas into groups, interrelationship digraphs attempt to define the 
ways in which ideas influence one another. It is best to use both affinity dia- 

grams and interrelationship digraphs. 
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The interrelationship digraph begins by writing down the ideas on small 
pieces of paper, such as Post-its'”. The pieces of paper are then placed on a 
large sheet of paper, such as a flip-chart sheet or a piece of large-sized blue-print 
paper. Arrows are drawn between related ideas. An idea that has arrows leaving 
it but none entering is a “root idea.” By evaluating the relationships between 
ideas you will get a better picture of the way things happen. The root ideas are 


often keys to improving the system. Figure 8.15 illustrates a simple interrela- 
tionship digraph. 
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Figure 8.15. How does “people management” impact change? 


Prioritization matrices* 


To prioritize is to arrange or deal with in order of importance. A prioritiza- 
tion matrix is a combination of a tree diagram and a matrix chart and it is used 
to help decision makers determine the order of importance of the activities 


*This chart replaces the matrix data analysis chart, formerly one of the 7M tools. The matrix data analysis chart was based on 


factor analysis or principal components analysis. This dependence on heavy-duty statistical methods made it unacceptable 


as a tool for use by non-statisticians on a routine basis. 
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or goals being considered. Prioritization matrices are designed to rationally 
narrow the focus of the team to those key issues and options which are 
most important to the organization. Brassard (1989, pp. 102-103) presents 
three methods for developing prioritization matrices: the full analytical 
criteria method, the combination interrelationship digraph (ID)/matrix 
method, and the consensus criteria method. We will discuss the three different 
methods. 


FULL ANALYTICAL CRITERIA METHOD 


The full analytical criteria method is based upon work done by Saaty (1988). 
Saaty’s approach is called the analytic hierarchy process (AHP). While analyti- 
cally rigorous, AHP is cumbersome in both data collection procedures and the 
analysis. This author recommends that this approach be reserved for truly 
“heavy-duty” decisions of major strategic importance to the organization. In 
those cases, you may wish to obtain consulting assistance to assure that the 
approach is properly applied. In addition, you may want to acquire software to 
assist in the analysis.* Brassard (1989) and Saaty (1988) provide detailed exam- 
ples of the application of the full analytical criteria approach. 


COMBINATION ID/MATRIX METHOD 


The interrelationship digraph (ID) is a method used to uncover patterns in 
cause and effect relationships (see above). This approach to creating a priori- 
tization matrix begins with a tree diagram (see above). Items at the right-most 
level of the tree diagram (the most detailed level) are placed in a matrix (ie., 
both the rows and columns of the matrix are the items from the right-most posi- 
tion of the tree diagram) and their impact on one another evaluated. The ID 
matrix is developed by starting with a single item, then adding items one by 
one. As each item is added, the team answers the question “is this item caused 
by X?” where X is another item. The process is repeated item by item until the 
relationship between each item and every other item has been determined. If 
the answer is “yes,” then an arrow is drawn between the “cause” item and the 
“effect” item. The strength of the relationship is determined by consensus. The 
final result is an estimate of the relative strength of each item and its effect on 
other items. 


*At the time of this writing, software was available from Quality America, Inc., in Tucson, Arizona, and Expert Choice, Inc., 


in Pittsburgh, Pennsylvania. 
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Figure 8.16. Combination ID/matrix method. 
Use the best mix of marketing medium. 


In Figure 8.16, an “in” arrow points left and indicates that the column item 
leads to the row item. On the ID, this would be indicated by an arrow from the 
column item to the row item. An “out” arrow points upward and indicates the 
opposite of an “in” arrow. To maintain symmetry, if an in arrow appears ina 
row/column cell, an out arrow must appear in the corresponding column/row 
cell, and vice versa. 

Once the final matrix has been created, priorities are set by evaluating the 
strength column, the total arrows column, and the relationship between the 
number of in and out arrows. An item with a high strength and a large number 
of out arrows would be a strong candidate because it is important (high 
strength) and it influences a large number of other options (many arrows, pre- 
dominately out arrows). Items with high strength and a large number of in 
arrows are candidates for outcome measures of success. 


CONSENSUS CRITERIA METHOD 


The consensus criteria method is a simplified approach to selecting from sev- 
eral options according to some criteria. It begins with a matrix where the differ- 
ent options under consideration are placed in rows and the criteria to be used 
are shown in columns. The criteria are given weights by the team using the con- 
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sensus decision rule. For example, if criterion #1 were given a weight of 3 and 
the group agreed that criterion 7/2 was twice as important, then criterion 7/2 
would receive a weight of 6. Another way to do the weighting is to give the 
team $1 in nickels and have them “spend” the dollar on the various criteria. 
The resulting value allocated to each criterion is its weight. The group then 
rank-orders the options based on each criterion. Ranks are labeled such that 
the option that best meets the criterion gets the highest rank; e.g., if there are 
five options being considered for a given criterion, the option that best meets 
the criterion is given a rank of 5. 

The options are then prioritized by adding up the option’s rank for each cri- 
terion multiplied by the criterion weight. 


Example of consensus criteria method 

A team had to choose which of four projects to pursue first. To help them 
decide, they identified four criteria for selection and their weights as follows: 
high impact on bottom line (weight = 0.25), easy to implement (0.15), low cost 
to implement (0.20) and high impact on customer satisfaction (0.40). The four 
projects were then ranked according to each of the criteria; the results are 
shown in the table below. 


Criteria and weights 


Weight > 0.25 0.15 0.2 0.4 
Bottom Low | Customer 
line Easy | cost | satisfaction | Total 
Project 1 1 2 2 1 1.35 
Project 2 3 4 4 3 3.35 
Project 3 2 1 3 4 2.85 
Project 4 4 3 1 Ze 2.45 


In the above example, the team would begin with project 7/2 because it has 
the highest score. If the team had difficulty reaching consensus on the weights 
or ranks, they could use totals or a method such as the nominal group technique 


described below. 
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Activity network diagram 

Activity network diagrams, sometimes called arrow diagrams, have their 
roots in well-established methods used in operations research. The arrow dia- 
gram is directly analogous to the critical path method (CPM) and the program 
evaluation and review technique (PERT) discussed in Chapter 15. These two 
project management tools have been used for many years to determine which 
activities must be performed, when they must be performed, and in what 
order. Unlike CPM and PERT, which require training in project management 
or systems engineering, arrow diagrams are greatly simplified so that they can 
be used with a minimum of training. An illustration of an arrow (PERT) dia- 
gram, is reproduced in Figure 8.17. 
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Figure 8.17. PERT network for constructing a house. 


Other continuous improvement tools 
Over the years, the tools of quality improvement have proliferated. By some 
estimates there are now over 400 tools in the “TQM Toolbox.” This author 
believes that it is possible to make dramatic improvements with the tools 
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already described, combined with the powerful statistical techniques described 
in other parts of this book. However, in addition to the tools already discussed, 
there are two more simple tools that the author believes deserve mention: the 
nominal group technique, and force-field analysis. These tools are commonly 
used to help teams move forward by obtaining input from all interested parties 
and identifying the obstacles they face. 


NOMINAL GROUP TECHNIQUE 


The nominal group technique (NGT) is a method for generating a “short 
list” of items to be acted upon. The NGT uses a highly structured approach 
designed to reduce the usual give-and-take among group members. Usage of 
the NGT is indicated when 1) the group is new or has several new members, 2) 
when the topic under consideration is controversial, or 3) when the team is 
unable to resolve a disagreement. Scholtes (1988) describes the steps involved 
in the NGT. A summary of the approach is shown below. 

Part I—A formalized brainstorm 

1. Define the task in the form of a question. 

2. Describe the purpose of this discussion and the rules and procedures of 

the NGT. 

3. Introduce and clarify the question. 

4. Generate ideas. Do this by having the team write down their ideas in 

silence. 

5. List the ideas obtained. 

6. Clarify and discuss the ideas. 


Part II—Making the selection 

1. Choose the top 50 ideas. Note: members can remove their ideas from 
consideration if they wish, but no member can remove another’s idea. 

2. Pass out index cards to each member, using the following table as a guide: 


IDEAS INDEX CARDS 
less than 20 4 cards 
20-35 6 cards 
36-50 8 cards 


3. Each member writes down their choices from the list, one choice per 
card. 
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4. Each member rank-orders their choices and writes the rank on the cards. 
5. Record the group’s choices and ranks. 
6. Group reviews and discusses the results. Consider: How often was an 
item selected? What is the total of the ranks for each item? 
If the team can agree on the importance of the item(s) that got the highest 
score(s) (sum of ranks), then the team moves on to preparing an action plan to 
deal with the item or items selected. 


FORCE-FIELD ANALYSIS 


Force-field analysis (FFA) is a method borrowed from the mechanical engi- 
neering discipline known as free-body diagrams. Free-body diagrams are 
drawn to help the engineer identify all the forces surrounding and acting on a 
body. The objective is to ascertain the forces leading to an equilibrium state for 
the body. 

In FFA the “equilibrium” is the status quo. FFA helps the team under- 
stand the forces that keep things the way they are. Some of the forces are 
“drivers” that move the system towards a desired goal. Other forces are 
“restrainers” that prevent the desired movement and may even cause move- 
ment away from the goal. Once the drivers and restrainers are known, the 
team can design an action plan which will 1) reduce the forces restraining 
progress and 2) increase the forces which lead to movement in the desired 
direction. 

FFA is useful in the early stages of planning. Once restrainers are explicitly 
identified, a strategic plan can be prepared to develop the drivers necessary to 
overcome them. FFA is also useful when progress has stalled. By performing 
FFA, people are brought together and guided toward consensus, an activity 
that, by itself, often overcomes a number of obstacles. Pyzdek (1994) lists the fol- 
lowing steps for conducting FFA. 

1. Determine the goal. 

2. Create a team of individuals with the authority, expertise, and interest 

needed to accomplish the goal. 

3. Have the team use brainstorming or the NGT to identify restrainers and 

drivers. 

4. Create a force-field diagram or table which lists the restrainers and 

drivers. 

5. Prepare a plan for removing restrainers and increasing drivers. 


An example of a force-field diagram is shown in Figure 8.18. 


276 PROBLEM SOLVING TOOLS 


Buying a Car 
Drivers Restraints 


Sale on now —*|«— Higher payments 
Low finance rate —»|<«— Want a boat instead 
Old car repair cost —* |¢— Wife will want one too 
Status symbol —+ |«— Old car not paid off 
«— Job not too sure 
«<— Kid in college 


Figure 8.18. Example of a force-field diagram. 
From Pocket Guide to Quality Tools, p. 10. Copyright © 1995 by Thomas Pyzdek. 


It may be helpful to assign “strength weights” to the drivers and restrainers 
(e.g., weak, moderate, strong). 
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CHAPTER 


Basic Principles of 
Measurement 


An argument can be made for asserting that quality begins with measure- 
ment. Only when quality is quantified can meaningful discussion about 
improvement begin. Conceptually, measurement is quite simple: measure- 
ment is the assignment of numbers to observed phenomena according to 
certain rules. Measurement is a sine qua non of any science, including manage- 
ment science. 


SCALES OF MEASUREMENT 


A measurement is simply a numerical assignment to something, usually a 
non-numerical element. Measurements convey certain information about the 
relationship between the element and other elements. Measurement involves a 
theoretical domain, an area of substantive concern represented as an empirical 
relational system, and a domain represented by a particular selected numerical 
relational system. There is a mapping function that carries us from the empirical 
system into the numerical system. The numerical system is manipulated and 
the results of the manipulation are studied to help the manager better under- 
stand the empirical system. 

In reality, measurement is problematic: the manager can never know the 
“true” value of the element being measured. The numbers provide information 
on a certain scale and they represent measurements of some unobservable vari- 
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able of interest. Some measurements are richer than others, i.e., some measure- 
ments provide more information than other measurements. The information 
content of a number is dependent on the scale of measurement used. This scale 
determines the types of statistical analyses that can be properly employed in 
studying the numbers. Until one has determined the scale of measurement, 
one cannot know if a given method of analysis is valid. 

The four measurement scales are: nominal, ordinal, interval, and ratio. 
Harrington (1992) summarizes the properties of each scale in Table 9.1. 


Table 9.1. Types of measurement scales and permissible statistics. 
From Quality Engineering Handbook, p.516. Copyright © 1992. Used by permission of 


the publisher, ASQ Quality Press, Milwaukee, Wisconsin. 


SCALE DEFINITION EXAMPLE STATISTICS 
Nominal Only the presence/absence of go/no go; percent; 
an attribute; can only count success/fail; proportion; 
items accept/reject chi-square tests 
Ordinal Can say that one item has taste; rank-order 
more or less of an attribute attractiveness correlation 
than another item; can order a 
set of items 
Interval Difference between any two calendar time; correlations; 
successive points is equal; temperature t-tests; F-tests; 
often treated as a ratio scale multiple 
even if assumption of equal regression 
intervals is incorrect; can add, 
subtract, order objects 
Ratio True zero point indicates elapsed time; t-test; F-test; 
absence of an attribute; can distance; weight | correlations; 
add, subtract, multiply and multiple 
divide regression 


Numbers on anominal scale aren’t measurements at all, they are merely cat- 
egory labels in numerical form. Nominal measurements might indicate mem- 
bership in a group (1=male, 2=female) or simply represent a designation 
(John Doe is ##43 on the team). Nominal scales represent the simplest and 
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weakest form of measurement. Nominal variables are perhaps best viewed as a 
form of classification rather than as a measurement scale. Ideally, categories on 
the nominal scale are constructed in such a way that all objects in the universe 
are members of one and only one class. Data collected on a nominal scale are 
called attribute data. The only mathematical operations permitted on nominal 
scales are = (which shows that an object possesses the attribute of concern) 
or F. 

An ordinal variable is one that has a natural ordering of its possible values, 
but for which the distances between the values are undefined. An example is 
product preference rankings such as good, better, best. Ordinal data can be ana- 
lyzed with the mathematical operators, = (equality), 4 (inequality), > (greater 
than) and < (less than). There are a wide variety of statistical techniques which 
can be applied to ordinal data including the Pearson correlation. Other ordinal 
models include odds-ratio measures, log-linear models and logit models, both 
of which are used to analyze cross-classifications of ordinal data presented in 
contingency tables. In quality management, ordinal data are commonly con- 
verted into nominal data and analyzed using binomial or Poisson models. For 
example, if parts were classified using a poor-good-excellent ordering, the qual- 
ity analyst might plot a p chart of the proportion of items in the poor category. 

Interval scales consist of measurements where the ratios of differences are 
invariant. For example, 90°C = 194°F, 180°C = 356°F, 270°C = 518°F, 360°C 
= 680°F. Now 194°F/90°C F 356°F/180°C but 


356°F — 194°F 180°C — 90°C 
680°F —518°F 360°C — 270°C 


Conversion between two interval scales is accomplished by the transforma- 
tion y = ax + b,a > 0. For example, °F = 32 + (2 x °C), where a = 9/5, 
b = 32. As with ratio scales, when permissible transformations are made statis- 
tical, results are unaffected by the interval scale used. Also, 0° (on either scale) 
is arbitrary. In this example, zero does not indicate an absence of heat. 

Ratio scale measurements are so called because measurements of an object in 
two different metrics are related to one another by an invariant ratio. For exam- 
ple, if an object’s mass was measured in pounds (x) and kilograms (y), then 
x/y = 2.2 for all values of x and y. This implies that a change from one ratio 
measurement scale to another is performed by a transformation of the form 
y = ax,a > 0;eg., pounds = 2.2 x kilograms. When permissible transforma- 
tions are used, statistical results based on the data are identical regardless of 
the ratio scale used. Zero has an inherent meaning: in this example it signifies 
an absence of mass. 


280 


Basic Principtes Of MEASUREMENT 


RELIABILITY AND VALIDITY OF DATA 


Fundamentally, any item measure should meet two tests: 

1. The item measures what it is intended to measure (i.e., it is valid). 

2. Aremeasurement would order individual responses in the same way (ie., 

it is reliable). 

The remainder of this section describes techniques and procedures 
designed to assure that measurement systems produce numbers with these 
properties. A good measurement system possesses certain properties. First, it 
should produce a number that is “close” to the actual property being 
measured, ie., it should be accurate. Second, if the measurement system is 
applied repeatedly to the same object, the measurements produced should be 
close to one another, ie., it should be repeatable. Third, the measurement 
system should be able to produce accurate and consistent results over the 
entire range of concern, ie., it should be linear. Fourth, the measurement 
system should produce the same results when used by any properly trained 
individual, ie, the results should be reproducible. Finally, when applied to 
the same items the measurement system should produce the same results in 
the future as it did in the past, ie., it should be stable. The remainder of this 
section is devoted to discussing ways to ascertain these properties for particu- 
lar measurement systems. In general, the methods and definitions presented 
here are consistent with those described by the Automotive Industry Action 
Group (AIAG). 


Definitions 


Bias—The difference between the average measured value and a reference 
value is referred to as bias. The reference value is an agreed-upon stan- 
dard, such as a standard traceable to a national standards body (see 
below). When applied to attribute inspection, bias refers to the ability 
of the attribute inspection system to produce agreement on inspection 
standards. Bias is controlled by calibration, which is the process of 
comparing measurements to standards. The concept of bias is illus- 
trated in Figure 9.1. 

Repeatability—AIAG defines repeatability as the variation in measure- 
ments obtained with one measurement instrument when used several 
times by one appraiser, while measuring the identical characteristic on 
the same part. Variation obtained when the measurement system is 
applied repeatedly under the same conditions is usually caused by con- 
ditions inherent in the measurement system. 
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REFERENCE AVERAGE 
VALUE MEASUREMENT 


Figure 9.1. Bias illustrated. 


ASQ defines precision as “The closeness of agreement between ran- 
domly selected individual measurements or test results. NOTE: The 
standard deviation of the error of measurement is sometimes called 
‘imprecision’.” This is similar to what we are calling repeatability. 
Repeatability is illustrated in Figure 9.2. 

Reproducibility—Reproducibility is the variation in the average of the mea- 
surements made by different appraisers using the same measuring 
instrument when measuring the identical characteristic on the same 
part. Reproducibility is illustrated in Figure 9.3. 

Stability—Stability is the total variation in the measurements obtained with 
a measurement system on the same master or parts when measuring a 
single characteristic over an extended time period. A system is said to 
be stable if the results are the same at different points in time. Stability 
is illustrated in Figure 9.4. 

Linearity—the difference in the bias values through the expected operating 
range of the gage. Linearity is illustrated in Figure 9.5. 
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Figure 9.2. Repeatability illustrated. 
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Figure 9.3. Reproducibility illustrated. Figure 9.4. Stability illustrated. 
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Figure 9.5. Linearity illustrated. 


OVERVIEW OF STATISTICAL METHODS 
Enumerative versus analytic statistical methods 


How would you respond to the following question? 


A sample of 100 bottles taken from a filling process has an average of 11.95 
ounces and a standard deviation of 0.1 ounce. The specifications are 11.9— 
12.1 ounces. Based on these results, should you 

a. Do nothing? 

b. Adjust the average to precisely 12 ounces? 
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c. Compute a confidence interval about the mean and adjust the 
process if the nominal fill level is not within the confidence 
interval? 

d. None of the above? 


The correct answer is d, none of the above. The other choices all make the 
mistake of applying enumerative statistical concepts to an analytic statistical 
situation. In short, the questions themselves are wrong! For example, based on 
the data, there is no way to determine if doing nothing is appropriate. “Doing 
something” implies that there is a known cause and effect mechanism which 
can be employed to reach a known objective. There is nothing to suggest that 
this situation exists. Thus, we can’t simply adjust the process average to the 
nominal value of 12 ounces, even though the process appears to be 5 standard 
errors below this value. This might have happened because the first 50 were 10 
standard errors below the nominal and the last 50 were exactly equal to the nom- 
inal (or any of a nearly infinite number of other possible scenarios). The confi- 
dence interval calculation fails for the same reason. Figure 9.6 illustrates some 
processes that could produce the statistics provided above. 

Some appropriate analytic statistics questions might be: 

e Is the process central tendency stable over time? 

e Is the process dispersion stable over time? 

¢ Does the process distribution change over time? 

If any of the above are answered “no,” then what is the cause of the insta- 
bility? To help answer this question, ask “what is the nature of the variation as 
revealed by the patterns?” when plotted in time-sequence and stratified in var- 
ious ways. 

If none of the above are answered “no,” then, and only then, we can ask such 
questions as 

e Is the process meeting the requirements? 

¢ Can the process meet the requirements? 

¢ Can the process be improved by recentering it? 

¢ How can we reduce variation in the process? 


WHAT ARE ENUMERATIVE AND ANALYTIC 
STUDIES? 


Deming (1975) defines enumerative and analytic studies as follows: 

Enumerative study—a study in which action will be taken on the universe. 

Analytic study—a study in which action will be taken on a process to 
improve performance in the future. 
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Figure 9.6. Possible processes with similar means and sigmas. 


The term “universe” is defined in the usual way: the entire group of interest, 
e.g., people, material, units of product, which possess certain properties of inter- 
est. An example of an enumerative study would be sampling an isolated lot to 
determine the quality of the lot. 

In an analytic study the focus is on a process and how to improve it. The focus 
is the future. Thus, unlike enumerative studies which make inferences about 
the universe actually studied, analytic studies are interested in a universe 
which has yet to be produced. Table 9.2 compares analytic studies with enu- 
merative studies (Provost, 1988). 

Deming (1986) points out that “Analysis of variance, t-tests, confidence 
intervals, and other statistical techniques taught in the books, however inter- 
esting, are inappropriate because they provide no basis for prediction and 
because they bury the information contained in the order of production.” 
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Table 9.2. Important aspects of analytic studies. 


ITEM ENUMERATIVE STUDY | ANALYTIC STUDY 

Aim Parameter estimation Prediction 

Focus Universe Process 

Method of Counts, statistics Models of the process 

access (e.g., flow charts, cause 
and effects, mathematical 
models) 

Major source of | Sampling variation Extrapolation into the 

uncertainty future 

Uncertainty Yes No 

quantifiable? 

Environment Static Dynamic 

for the study 


These traditional statistical methods have their place, but they are widely 
abused in the real world. When this is the case, statistics do more to cloud the 
issue than to enlighten. 

Analytic study methods provide information for inductive thinking, rather 
than the largely deductive approach of enumerative statistics. Analytic meth- 
ods are primarily graphical devices such as run charts, control charts, his- 
tograms, interrelationship digraphs, etc. Analytic statistics provide 
operational guidelines, rather than precise calculations of probability. Thus, 
such statements as “There is a 0.13% probability of a Type I error when acting 
on a point outside a three-sigma control limit” are false (the author admits 
to having made this error in the past). The future cannot be predicted with a 
known level of confidence. Instead, based on knowledge obtained from every 
source, including analytic studies, one can state that one has a certain degree 
of belief (e.g., high, low) that such and such will result from such and such 
action on a process. 

Another difference between the two types of studies is that enumerative 
statistics proceed from predetermined hypotheses while analytic studies try 
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to help the analyst generate new hypotheses. In the past, this extremely worth- 
while approach has been criticized by some statisticians as “fishing” or “ratio- 
nalizing.” However, this author believes that using data to develop plausible 
explanations retrospectively is a perfectly legitimate way of creating new the- 
ories to be tested. To refuse to explore possibilities suggested by data is to 
take a very limited view of the scope of statistics in quality improvement and 
control. 


Enumerative statistical methods 


This section discusses the basic concept of statistical inference. The reader 
should also consult the Glossary in the Appendix for additional information. 
Inferential statistics belong to the enumerative class of statistical methods. 

The term inference is defined as 1) the act or process of deriving logical con- 
clusions from premises known or assumed to be true, or 2) the act of reasoning 
from factual knowledge or evidence. Inferential statistics provide information 
that is used in the process of inference. As can be seen from the definitions, infer- 
ence involves two domains: the premises and the evidence or factual knowledge. 
Additionally, there are two conceptual frameworks for addressing premises 
questions in inference: the design-based approach and the model-based 
approach. 

As discussed by Koch and Gillings (1983), a statistical analysis whose only 
assumptions are random selection of units or random allocation of units to 
experimental conditions results in design-based inferences; or, equivalently, 
randomization-based inferences. The objective is to structure sampling such 
that the sampled population has the same characteristics as the target popula- 
tion. If this is accomplished then inferences from the sample are said to have 
internal validity. A limitation on design-based inferences for experimental stu- 
dies is that formal conclusions are restricted to the finite population of sub- 
jects that actually received treatment, that is, they lack external validity. 
However, if sites and subjects are selected at random from larger eligible 
sets, then models with random effects provide one possible way of addressing 
both internal and external validity considerations. One important considera- 
tion for external validity is that the sample coverage includes all relevant 
subpopulations; another is that treatment differences be homogeneous across 
subpopulations. A common application of design-based inference is the 
survey. 

Alternatively, if assumptions external to the study design are required to 
extend inferences to the target population, then statistical analyses based on 
postulated probability distributional forms (e.g., binomial, normal, etc.) or 
other stochastic processes yield model-based inferences. A focus of distinction 
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between design-based and model-based studies is the population to which the 
results are generalized rather than the nature of the statistical methods applied. 
When using a model-based approach, external validity requires substantive jus- 
tification for the model’s assumptions, as well as statistical evaluation of the 
assumptions. 

Statistical inference is used to provide probabilistic statements regarding a 
scientific inference. Science attempts to provide answers to basic questions, 
such as can this machine meet our requirements? Is the quality of this lot 
within the terms of our contract? Does the new method of processing produce 
better results than the old? These questions are answered by conducting an 
experiment, which produces data. If the data vary, then statistical inference 
is necessary to interpret the answers to the questions posed. A statistical 
model is developed to describe the probabilistic structure relating the 
observed data to the quantity of interest (the parameters), i.e., a scientific 
hypothesis is formulated. Rules are applied to the data and the scientific 
hypothesis is either rejected or not. In formal tests of a hypothesis, there are 
usually two mutually exclusive and exhaustive hypotheses formulated: a null 
hypothesis and an alternate hypothesis. Formal hypothesis testing is discussed 
later in this chapter. 


DISCRETE AND CONTINUOUS DATA 


Data are said to be discrete when they take on only a finite number of points 
that can be represented by the non-negative integers. An example of discrete 
data is the number of defects in a sample. Data are said to be continuous when 
they exist on an interval, or on several intervals. An example of continuous 
data is the measurement of pH. Quality methods exist based on probability 
functions for both discrete and continuous data. 


METHODS OF ENUMERATION 


Enumeration involves counting techniques for very large numbers of poss- 
ible outcomes. This occurs for even surprisingly small sample sizes. In Six 
Sigma, these methods are commonly used in a wide variety of statistical proce- 
dures. 

The basis for all of the enumerative methods described here is the multi- 
plication principle. The multiplication principle states that the number of poss- 
ible outcomes of a series of experiments is equal to the product of the number 
of outcomes of each experiment. For example, consider flipping a coin twice. 
On the first flip there are two possible outcomes (heads/tails) and on the second 
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flip there are also two possible outcomes. Thus, the series of two flips can result 
in2 x 2 = 4 outcomes. Figure 9.7 illustrates this example. 


HEAD 


TAIL 


HEAD 


TAIL 


Figure 9.7. Multiplication principle applied to coin flips. 


An ordered arrangement of elements is called a permutation. Suppose that 
you have four objects and four empty boxes, one for each object. Consider 
how many different ways the objects can be placed into the boxes. The first 
object can be placed in any of the four boxes. Once this is done there are three 
boxes to choose from for the second object, then two boxes for the third object 
and finally one box left for the last object. Using the multiplication principle 
you find that the total number of arrangements of the four objects into the 
four boxes is 4 x 3 x 2 x 1 = 24. In general, if there are n positions to be filled 
with objects there are 


n(n — 1)...(2)(1) =n! (9.1) 


possible arrangements. The symbol m! is read n factorial. By definition, 0! = 1. 

In applying probability theory to discrete variables in quality control we fre- 
quently encounter the need for efficient methods of counting. One counting 
technique that is especially useful is combinations. The combination formula 
is shown in Equation 9.2. 


! 
n) 
Ct 
"—— yl(n — 1)! 


(9.2) 
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Combinations tell how many unique ways you can arrange n objects taking 
them in groups of r objects at a time, where r is a positive integer less than or 
equal to 7. For example, to determine the number of combinations we can 
make with the letters X,Y, and Z in groups of 2 letters at a time, we note that 
n = 3 letters,r = 2 letters at a time and use the above formula to find 


ae BY. BRIT. 6 
2218-2)! (2x D0) 2 


The 3 combinations are XY, XZ, and YZ. Notice that this method does not 
count reversing the letters as separate combinations, i.e. XY and YX are con- 
sidered to be the same. 


Assumptions and robustness of tests 


It is important at the outset to comment on what we are not discussing here 
when we use the term “robustness.” First, we are not talking about the sensi- 
tivity of a particular statistic to outliers. This concept is more properly 
referred to as resistance and it is discussed in the exploratory data analysis 
section of this book. We are also not speaking of a product design that can 
perform well under a wide variety of operating conditions. This design-based 
definition of robustness is discussed in the Taguchi robustness concepts 
section. 

All statistical procedures rest upon certain assumptions. For example, 
ANOVA assumes that the data are normally distributed with equal variances. 
When we use the term robustness here, we mean the ability of the statistical pro- 
cedure to produce the correct final result when the assumptions are violated. A 
statistical procedure is said to be robust when it can be used even when the 
basic assumptions are violated to a small degree. 

How large a departure from the assumptions is acceptable? Or, equivalently, 
how small is a “small” degree of error? For a given violation of the assumptions, 
how large an error in the result is acceptable? Regrettably, there is no rigorous 
mathematical definition of the term “robust.” 

In practice, robustness is commonly addressed in two ways. One approach is 
to test the underlying assumptions prior to using a given statistical procedure. 
In the case of ANOVA, for example, the practitioner would test the assump- 
tions of normality and constant variance on the data set before accepting the 
results of the ANOVA. 

Another approach is to use robust statistical procedures. Some ways of deal- 
ing with the issue are: 


Overview of statistical methods 291 


* Use procedures with less restrictive underlying assumptions (e.g., non- 
parametric procedures). 

¢ Drop “gross outliers” from the data set before proceeding with the analy- 
sis (using an acceptable statistical method to identify the outliers). 

¢ Use more resistant statistics (e.g, the median instead of the arithmetic 
mean). 


Distributions 


Distributions are a set of numbers collected from a well-defined universe of 
possible measurements arising from a property or relationship under study. 
Distributions show the way in which the probabilities are associated with 
the numbers being studied. Assuming a state of statistical control, by con- 
sulting the appropriate distribution one can determine the answer to such 
questions as: 

e What is the probability that x will occur? 

e What is the probability that a value less than x will occur? 

¢ What is the probability that a value greater than x will occur? 

e What is the probability that a value will occur that is between x and y? 

By examining plots of the distribution shape, one can determine how rapidly 
or slowly probabilities change over a given range of values. In short, distribu- 
tions provide a great deal of information. 


FREQUENCY AND CUMULATIVE DISTRIBUTIONS 


A frequency distribution is an empirical presentation of a set of observations. 
If the frequency distribution is ungrouped, it simply shows the observations 
and the frequency of each number. If the frequency distribution is grouped, 
then the data are assembled into cells, each cell representing a subset of the 
total range of the data. The frequency in each cell completes the grouped fre- 
quency distribution. Frequency distributions are often graphically displayed 
in histograms or stem-and-leaf plots. 

While histograms and stem-and-leaf plots show the frequency of specific 
values or groups of values, analysts often wish to examine the cumulative fre- 
quency of the data. The cumulative frequency refers to the total up to and 
including a particular value. In the case of grouped data, the cumulative fre- 
quency is computed as the total number of observations up to and including a 
cell boundary. Cumulative frequency distributions are often displayed on an 
ogive, as depicted in Figure 9.8. 
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Figure 9.8. Ogive of rod diameter data. 


SAMPLING DISTRIBUTIONS 


In most Six Sigma projects involving enumerative statistics, we deal with 
samples, not populations. In the previous section, sample data were used to con- 
struct an ogive and, elsewhere in this book, sample data are used to construct 
histograms, stem-and-leaf plots, boxplots, and to compute various statistics. 
We now consider the estimation of certain characteristics or parameters of the 
distribution from the data. 

The empirical distribution assigns the probability 1/1 to each X; in the sam- 
ple, thus the mean of this distribution is 


e ” 1 


The symbol X is called “X bar.” Since the empirical distribution is deter- 
mined by a sample, X is simply called the sample mean. 
The variance of the empirical distribution is given by 


n 


9 = : 2 SK; — XY (9.4) 


i=1 
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: : Dos ‘ 
This equation for S” is commonly referred to as the sample variance. The 
unbiased sample standard deviation is given by 


(9.5) 


Another sampling statistic of special interest in Six Sigma is the standard 
deviation of the sample average, also referred to as the standard error of the 
mean or simply the standard error. This statistic is given by 


goes (9.6) 


S| 


As can be seen, the standard error of the mean is inversely proportional to the 
square root of the sample size. That is, the larger the sample size, the smaller 
the standard deviation of the sample average. This relationship is shown in 
Figure 9.9. It can be seen that averages of n=4 have a distribution half as variable 
as the population from which the samples are drawn. 


DISTRIBUTION OF 
AVERAGES OF 
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DISTRIBUTION 


Figure 9.9. Effect of sample size on the standard error. 
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Probability distributions for Six Sigma 
This section discusses the following probability distributions often used in 
Six Sigma: 
¢ Binomial distribution 
¢ Poisson distribution 
¢ Hypergeometric distribution 
¢ Normal distribution 
e Exponential distribution 
¢ Chi-square distribution 
¢ Student’s t distribution 
e F distribution 


BINOMIAL DISTRIBUTION 


Assume that a process is producing some proportion of non-conforming 
units, which we will call p. If we are basing p on a sample we find p by dividing 
the number of non-conforming units in the sample by the number of items 
sampled. The equation that will tell us the probability of getting x defectives in 
a sample of 7 units is shown by Equation 9.7. 


P(x) = Cyp*(1 — py” * (9.7) 


This equation is known as the binomial probability distribution. In addition 
to being useful as the exact distribution of non-conforming units for processes 
in continuous production, it is also an excellent approximation to the cum- 
bersome hypergeometric probability distribution when the sample size is less 
than 10% of the lot size. 


Example of applying the binomial probability distribution 
A process is producing glass bottles on a continuous basis. Past history shows 
that 1% of the bottles have one or more flaws. If we draw a sample of 10 units from 
the process, what is the probability that there will be 0 non-conforming bottles? 
Using the above information, n = 10, p = .01, and x = 0. Substituting these 
values into Equation 9.7 gives us 


P(0) = Co°0.01°(1 — 0.01) ° = 1 x 1 x 0.99" = 0.904 = 90.4% 


Another way of interpreting the above example is thatasampling plan “inspect 
10 units, accept the process if no non-conformances are found” has a 90.4% prob- 
ability of accepting a process that is averaging 1% non-conforming units. 
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ad of binomial probability calculations using Microsoft 


Excel 

Microsoft Excel has a built-in capability to analyze binomial probabilities. To 
solve the above problem using Excel, enter the sample size, p value, and x value 
as shown in Figure 9.10. Note the formula result near the bottom of the screen. 


BINOMDIST *| xX ¥ = =BINOMDIST(B4,B1,B2,FALSE) 


= 0.904382075 


Returns the individual term binomial distribution probability, 


Number _s is the number of successes in trials. 


Formula result =0,904382075 Cancel 


Figure 9.10. Example of finding binomial probability using Microsoft Excel. 


Poisson distribution 

Another situation encountered often in quality control is that we are not just 
concerned with units that don’t conform to requirements, instead we are con- 
cerned with the number of non-conformances themselves. For example, let’s 
say we are trying to control the quality of a computer. A complete audit of the 
finished computer would almost certainly reveal some non-conformances, 
even though these non-conformances might be of minor importance (for exam- 
ple, a decal on the back panel might not be perfectly straight). If we tried to use 
the hypergeometric or binomial probability distributions to evaluate sampling 
plans for this situation, we would find they didn’t work because our lot or pro- 
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cess would be composed of 100% non-conforming units. Obviously, we are 
interested not in the units per se, but in the non-conformances themselves. In 
other cases, it isn’t even possible to count sample units per se. For example, the 
number of accidents must be counted as occurrences. The correct probability 
distribution for evaluating counts of non-conformances is the Poisson distribu- 
tion. The pdf is given in Equation 9.8. 


Pea = — (9.8) 


In Equation 9.8, [1 is the average number of non-conformances per unit, x is 
the number of non-conformances in the sample, and e is the constant approxi- 
mately equal to 2.7182818. P(x) gives the probability of exactly x occurrences in 
the sample. 


Example of applying the Poisson distribution 

A production line is producing guided missiles. When each missile is com- 
pleted, an audit is conducted by an Air Force representative and every non- 
conformance to requirements is noted. Even though any major non- 
conformance is cause for rejection, the prime contractor wants to control 
minor non-conformances as well. Such minor problems as blurred stencils, 
small burrs, etc., are recorded during the audit. Past history shows that on the 
average each missile has 3 minor non-conformances. What is the probability 
that the next missile will have 0 non-conformances? 

We have tp = 3, x = 0. Substituting these values into Equation 9.8 gives us 

ae 

0! 


_ 1x 0.05 


PO): = = 0.05: = 55 


In other words, 100% —5% = 95% of the missiles will have at least one non- 
conformance. 

The Poisson distribution, in addition to being the exact distribution for the 
number of non-conformances, is also a good approximation to the binomial dis- 
tribution in certain cases. To use the Poisson approximation, you simply let 
(4 = np in Equation 9.8. Juran (1988) recommends considering the Poisson 
approximation if the sample size is at least 16, the population size is at least 10 
times the sample size, and the probability of occurrence p on each trial is less 
than 0.1. The major advantage of this approach is that it allows you to use the 
tables of the Poisson distribution, such as Table 7 in the Appendix. Also, the 
approach is useful for designing sampling plans. 
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Example of Poisson probability calculations using Microsoft 
Excel 

Microsoft Excel has a built-in capability to analyze Poisson probabilities. To 
solve the above problem using Excel, enter the average and x values as shown 
in Figure 9.11. Note the formula result near the bottom of the screen. 


vVixX Js 


=POISSON(B2,B1,0) 


x [a2 Y=0 
Mean [b1 AJ=3 


Cumulative | “tj = FALSE 


= 0,049787068 


Returns the Poisson distribution. 


Cumulative is a logical value: for the cumulative Polsson probability, use TRUE; for 
the Poisson probability mass function, use FALSE. 


Formula result =0,049787068 [oxen] Cancel 


Figure 9.11. Example of finding Poisson probability using Microsoft Excel. 


HYPERGEOMETRIC DISTRIBUTION 


Assume we have received a lot of 12 parts from a distributor. We need the 
parts badly and are willing to accept the lot if it has fewer than 3 non-conforming 
parts. We decide to inspect only 4 parts since we can’t spare the time to check 
every part. Checking the sample, we find 1 part that doesn’t conform to the 
requirements. Should we reject the remainder of the lot? 

This situation involves sampling without replacement. We draw a unit from 
the lot, inspect it, and draw another unit from the lot. Furthermore, the lot is 
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quite small, the sample is 25% of the entire lot. The formula needed to compute 
probabilities for this procedure is known as the hypergeometric probability dis- 
tribution, and it is shown in Equation 9.9. 


P(x) = (9.9) 


In the above equation, N is the lot size, m is the number of defectives in the 
lot, n is the sample size, x is the number of defectives in the sample, and P(x) is 
the probability of getting exactly x defectives in the sample. Note that the 
numerator term C’” gives the number of combinations of non-defectives 
while CY’ is the number of combinations of defectives. Thus the numerator 
gives the total number of arrangements of samples from lots of size N with m 
defectives where the sample n contains exactly x defectives. The term Cy’ in 
the denominator is the total number of combinations of samples of size n from 
lots of size N, regardless of the number of defectives. Thus, the probability is a 
ratio of the likelihood of getting the result under the assumed conditions. 

For our example, we must solve the above equation for x = Oas well as x = 1, 
since we would also accept the lot if we had no defectives. The solution is 
shown as follows. 


CpG 126 


P(0) = = = 0.255 
©) ce 495 
Cy°C} =84x3 «252 
P) =—>—- = = —— = 0.509 
ée 495 495 


P(1 or less) = P(0) + P(1) 


Adding the two probabilities tells us the probability that our sampling plan 
will accept lots of 12 with 3 non-conforming units. The plan of inspecting 4 
parts and accepting the lot if we have 0 or 1 non-conforming has a probability 
of .255 + .509 = .764, or 76.4%, of accepting this “bad” quality lot. This is the 
“consumer’s risk” for this sampling plan. Such a high sampling risk would be 
unacceptable to most people. 


Example of hypergeometric probability calculations using 


Microsoft Excel 

Microsoft Excel has a built-in capability to analyze hypergeometric probabil- 
ities. To solve the above problem using Excel, enter the population and sample 
values as shown in Figure 9.12. Note the formula result near the bottom of the 
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A B (> 
Prob of less than or equal to sample 
x in a sample of n from a population 


21 N with population X successes 
22 |Population N 12 
23 | Population 
24 |Sample n 4 
25 |A ’ : 
26 | Sample o 1 
27 Prob 0254545455 .$B$22) 
HYPGEOMOIST 
Sample _ sfc $26 a1 = 
Number _sampie [s2524 = = 
Population _s fata 3] 3 
Number_pop [$2522 3] =l2 


Returns the hypergeometre dst button 


Sample_s is the number of successes in the sample. 
G) Formula result =0.509090909 [ox] Carcel 


Figure 9.12. Example of finding hypergeometric probability using Microsoft Excel. 


screen (0.509) gives the probability for x = 1. To find the cumulative probability 
you need to sum the probabilities for x = 0 and x = 1 etc. 


NORMAL DISTRIBUTION 


The most common continuous distribution encountered in Six Sigma work 
is, by far, the normal distribution. Sometimes the process itself produces an 
approximately normal distribution, other times a normal distribution can be 
obtained by performing a mathematical transformation on the data or by 
using averages. The probability density function for the normal distribution is 
given by Equation 9.10. 


1 93.23 
f(x) = —=e & 2 (9.10) 


o/ 20 


If f(x) is plotted versus x, the well-known “bell curve” results. The normal 
distribution is also known as the Gaussian distribution. An example is shown 
in Figure 9.13. 
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Figure 9.13. The normal/Gaussian curve. 


In Equation 9.10, tL is the population average or mean and O is the popula- 
tion standard deviation. These parameters have been discussed earlier in this 
chapter. 


Example of calculating 1, 07 and o 
Find pt, 0° and o for the following data: 
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To find the mean for our data we compute 
1 
p= (17 +23 +5) = 15 


The variance and standard deviation are both measures of dispersion or 
: Fi 2 oy at 
spread. The equations for the population variance O° and standard deviation 0 
are given in Table 11.4. 


Referring to the data above with a mean | of 15, we compute O° and o as 
follows: 


1 
2 23 8 64 
3 5 —10 100 


SUM 168 


o” = 168/3 = 56 


o= fo = /56 © 7.483 


Usually we have only a sample and not the entire population. A population is 
the entire set of observations from which the sample, a subset, is drawn. 
Calculations for the sample mean, variance, and standard deviation were 
shown earlier in this chapter. 

The areas under the normal curve can be found by integrating Equation 9.10 
using numerical methods, but, more commonly, tables are used. Table 2 in the 
Appendix gives areas under the normal curve. The table is indexed by using the 
Z transformation, which is 


—A (9.11) 
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for population data, or 


(9.12) 


for sample data. 

By using the Z transformation, we can convert any normal distribution into a 
normal distribution with a mean of 0 and a standard deviation of 1. Thus, we 
can use a single normal table to find probabilities. 


Example 

The normal distribution is very useful in predicting long-term process yields. 
Assume we have checked the breaking strength of a gold wire bonding process 
used in microcircuit production and we have found that the process average 
strength is 97 and the standard deviation is 474. The process distribution is 
normal. If the engineering specification is 374 minimum, what percentage of 
the process will be below the low specification? 

Since our data are a sample, we must compute Z using Equation 9.12. 


Figure 9.14 illustrates this situation. 


Z=-1.5 H: 


Figure 9.14. Illustration of using Z tables for normal areas. 
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Entering Table 2 in the Appendix for Z = —1.5, we find that 6.68% of the 
area is below this Z value. Thus 6.68% of our breaking strengths will be below 
our low specification limit of 37. In quality control applications, we usually 
try to have the average at least 3 standard deviations away from the specification. 
To accomplish this, we would have to improve the process by either raising the 
average breaking strength or reducing the process standard deviation, or both. 


Example of normal probability calculations using Microsoft 


Excel 

Microsoft Excel has a built-in capability to analyze normal probabilities. To 
solve the above problem using Excel, enter the average, sigma and x values as 
shown in Figure 9.15. The formula result near the bottom of the screen gives 
the desired probability. 


Average 
Sigma 


s 


P(less than x) [11,82,1) 


NORMDIST 


ah Wh 


i=3 
Mean [21 "J=9 
4, 


= 0.066807229 
Returns the normal cumulative distribution for the specified mean and standard deviation. 


Cumulative is 3 logical value; for the cumulative distribution function, use TRUE; for 
the probability mass function, use FALSE. 


| Formuta result =0.066807229 Cancel | 


Figure 9.15. Example of finding normal probability using Microsoft Excel. 
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EXPONENTIAL DISTRIBUTION 


Another distribution encountered often in quality control work is the expo- 
nential distribution. The exponential distribution is especially useful in ana- 
lyzing reliability (see Chapter 16). The equation for the probability density 
function of the exponential distribution is 


f(x) = os x>0 (9.13) 


Unlike the normal distribution, the shape of the exponential distribution is 
highly skewed and there is a much greater area below the mean than above it. 
In fact, over 63% of the exponential distribution falls below the mean. Figure 
9.16 shows an exponential pdf. 

Unlike the normal distribution, the exponential distribution has a closed 
form cumulative density function (cdf), ie., there is an equation which gives 
the cumulative probabilities directly. Since the probabilities can be determined 
directly from the equation, no tables are necessary. See equation 9.14. 


P(X <x) =1-e */" (9.14) 


U 
Figure 9.16. Exponential pdf curve. 
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Example of using the exponential cdf 

A city water company averages 500 system leaks per year. What is the prob- 
ability that the weekend crew, which works from 6 p.m. Friday to 6 a.m. 
Monday, will get no calls? 

We have Lt = 500 leaks per year, which we must convert to leaks per hour. 
There are 365 days of 24 hours each in a year, or 8760 hours. Thus, mean time 
between failures (MTBF) is 8760/500 = 17.52 hours. There are 60 hours between 
6 p.m. Friday and 6 a.m. Monday. Thus x = 60. Using Equation 9.14 gives 


P(X < 60) =1—¢ 7? = 0.967 = 96.7% 


Thus, the crew will get to loaf away 3.3% of the weekends. 


Example of exponential probability calculations using 


Microsoft Excel 

Microsoft Excel has a built-in capability to analyze exponential probabilities. 
To solve the above problem using Excel, enter the average and x values as 
shown in Figure 9.17. Note that Excel uses “Lambda” rather than the average 


EXPONDIST *|X ¥ = =EXPONDIST(B2,1/B1,1) 


A B & D E | fr 
1 |MTBF 17.52 
a \x 60 
3 ; 
4 |P(less than x) ,1/B1,1) 
EXPONDIST 


Cumulative {1 a = TRUE 


= 0.96743957 
Returns the exponential distribution. See Help for the equations used. 


Cumulative is a logical value for the function to return: the cumulative distribution 
function = TRUE; the probability density function = FALSE, 


Formula result =0.96743957 Cancel 


Figure 9.17. Example of finding exponential probability using Microsoft Excel. 
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in its calculations; lambda is the reciprocal of the average. The formula result 
near the bottom of the screen gives the desired probability. 


CHI-SQUARE, STUDENT’S T, AND F DISTRIBUTIONS 


These three distributions are used in Six Sigma to test hypotheses, construct 
confidence intervals, and compute control limits. 


CHI-SQUARE 

Many characteristics encountered in Six Sigma have normal or approxi- 
mately normal distributions. It can be shown that in these instances the distribu- 
tion of sample variances has the form (except for a constant) of a chi-square 
distribution, symbolized x’. Tables have been, constructed giving abscissa 
values for selected ordinates of the cumulative x’ distribution. One such table 
is Table 4 in the Appendix. 

The x? distribution varies with the quantity v, which for our purposes is 
equal to the sample size minus 1. For each value of v there is a different x7 dis- 
tribution. Equation 9.15 gives the pdf for the x”. 


Ve xX /2 (62) 0-2? 


(= = =)! 
2 


Figure 9.18 shows the pdf for v = 4. 


ee (9.15) 


Example 

The use of x7 is illustrated in this example to find the probability that the var- 
iance of a sample of n items from a specified normal universe will equal or 
exceed a given value s°; we compute x° = (n — I)s° /o°. Now, let’s suppose 
that we sample n = 10 items from a process with o* = 25 and wish to deter- 
mine the probability that the sample variance will exceed 50. Then 


(n — 1)s’ __ 950) 


= = 18 
o 25 


We enter Appendix Table 4 (x7) at the line for v = 10 — 1 = 9 and note that 
18 falls between the columns for the percentage points of 0.025 and 0.05. Thus, 
the probability of getting a sample variance in excess of 50 is about 3%. 

It is also possible to determine the sample variance that would be exceeded 
only a stated percentage of the time. For example, we might want to be alerted 
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Figure 9.18. x” pdf for v = 4. 


when the sample variance exceeded a value that should occur only once in 100 
times. Then we set up the x” equation, find the critical value from Table 4 in the 
Appendix, and solve for the sample variance. Using the same values as above, 
the value of s* that would be exceeded only once in 100 times is found as follows: 


95° 95° 5 LP C25 


>zG HT gH 17 SS SF = —W— = 60.278 
25 9 


o2 


In other words, the variance of samples of size 10, taken from this process, 
should be less than 60.278, 99% of the time. 


Example of chi-squared probability calculations using 


Microsoft Excel 

Microsoft Excel has a built-in capability to calculate chi-squared probabil- 
ities. To solve the above problem using Excel, enter the n and x values as 
shown in Figure 9.19. Note that Excel uses degrees of freedom rather than the 
sample size in its calculations; degrees of freedom is the sample size minus 
one, as shown in the Deg_freedom box in Figure 9.19. The formula result near 
the bottom of the screen gives the desired probability. 
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cubist | ¥) & Y) =) =CHIDIST(B2,B1-1) 
A | 8 | «| ® | € T CE 


= 
18 


= 0.03517354 
Returns the one-tailed probability of the chi-squared distribution. 


Deg_freedom is the number of degrees of freedom, a number between 1 and 1010, 
excluding 1010. 


Q) | Formula result =0,03517354 [oR Cancel 


Figure 9.19. Example of finding chi-squared probability using Microsoft Excel. 


Example of inverse chi-squared probability calculations using 


Microsoft Excel 

Microsoft Excel has a built-in capability to calculate chi-squared probabilities, 
making it unnecessary to look up the probabilities in tables. To find the critical 
chi-squared value for the above problem using Excel, use the CHIINV function 
and enter the desired probability and degrees of freedom as shown in Figure 9.20. 
The formula result near the bottom of the screen gives the desired critical value. 


CHIINV 


Probability { 01 3] = 0.01 
Deg_freedom [3 3] = 


= 21.66604759 
Returns the inverse of the one-tailed probability of the chi-squared distribution. 


Deg_freedom is the number of degrees of freedom, a number between 1 and 1010, 
excluding 1010. 


) | Formula result =21.66604759 [ « | Cancel 


Figure 9.20. Example of finding inverse chi-squared probability using Microsoft Excel. 
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STUDENT'S T DISTRIBUTION 


The ¢ statistic is commonly used to test hypotheses regarding means, regres- 
sion coefficients and a wide variety of other statistics used in quality engi- 
neering. “Student” was the pseudonym of W.S. Gosset, whose need to 
quantify the results of small scale experiments motivated him to develop and 
tabulate the probability integral of the ratio which is now known as the ¢ 
statistic and is shown in Equation 9.16. 


eS (9.16) 


In Equation 9.16, the denominator is the standard deviation of the sample 
mean. Percentage points of the corresponding distribution function of t may 
be found in Table 3 in the Appendix. There is a ¢ distribution for each sample 
size of nm > 1. As the sample size increases, the ¢ distribution approaches the 
shape of the normal distribution, as shown in Figure 9.21. 

One of the simplest (and most common) applications of the Student’s ¢ test 
involves using a sample from a normal population with mean [Ll and variance 
O°. This is demonstrated in the Hypothesis testing section later in this chapter. 


NORMAL DISTRIBUTION 
ane 


N=co 


t DISTRIBUTION FOR 
n=10 


t DISTRIBUTION 
FOR n=2 


Figure 9.21. Student’s ¢ distributions. 


310 


Basic Principtes of MEASUREMENT 


F DISTRIBUTION 


Suppose we have two random samples drawn from a normal population. Let 
s; be the variance of the first sample and s, be the variance of the second sample. 
The two samples need not have the same sample size. The statistic F given by 
si 
m2 


has a sampling distribution called the F distribution. There are two sample var- 
iances involved and two sets of degrees of freedom, n,—1 in the numerator and 
n,—1 in the denominator. The Appendix includes tables for 1% and 5% percen- 
tage points for the F distribution. The percentages refer to the areas to the 
right of the values given in the tables. Figure 9.22 illustrates two F distributions. 


oOor-A NN WOK A HDN OW 


Figure 9.22. F distributions. 
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Statistical inference 


All statements made in this section are valid only for stable processes, ie., 
processes in statistical control. The statistical methods described in this section 
are enumerative. Although most applications of Six Sigma are analytic, there 
are times when enumerative statistics prove useful. In reading this material, 
the analyst should keep in mind the fact that analytic methods should also be 
used to identify the underlying process dynamics and to control and improve 
the processes involved. The subject of statistical inference is large and it is cov- 
ered in many different books on introductory statistics. In this book we review 
that part of the subject matter of particular interest in Six Sigma. 


POINT AND INTERVAL ESTIMATION 


So far, we have introduced a number of important statistics including the 
sample mean, the sample standard deviation, and the sample variance. These 
sample statistics are called point estimators because they are single values used 
to represent population parameters. It is also possible to construct an interval 
about the statistics that has a predetermined probability of including the true 
population parameter. This interval is called a confidence interval. Interval esti- 
mation is an alternative to point estimation that gives us a better idea of the mag- 
nitude of the sampling error. Confidence intervals can be either one-sided or 
two-sided. A one-sided or confidence interval places an upper or lower bound 
on the value of a parameter with a specified level of confidence. A two-sided 
confidence interval places both upper and lower bounds. 

In almost all practical applications of enumerative statistics, including Six 
Sigma applications, we make inferences about populations based on data from 
samples. In this chapter, we have talked about sample averages and standard 
deviations; we have even used these numbers to make statements about future 
performance, such as long term yields or potential failures. A problem arises 
that is of considerable practical importance: any estimate that is based on a sam- 
ple has some amount of sampling error. This is true even though the sample esti- 
mates are the “best estimates” in the sense that they are (usually) unbiased 
estimators of the population parameters. 


Estimates of the mean 

For random samples with replacement, the sampling distribution of X has a 
mean [landa standard deviation equal to 0 /,/n. For large samples the sampling 
distribution of X is approximately normal and normal tables can be used to 
find the probability that a sample mean will be within a given distance of LL. 
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For example, in 95% of the samples we will observe a mean within +1.960/,/n 
of jt. In other words, in 95% of the samples the interval from X — 1.960/,/n to 
X + 1.960/,/n will include pt. This interval is called a “95% confidence interval 
for estimating pL.” It is usually shown using inequality symbols: 


X —1.960/Jn < wp <X4+1.960/./n 


The factor 1.96 is the Z value obtained from the normal Table 2 in the 
Appendix. It corresponds to the Z value beyond which 2.5% of the population 
lie. Since the normal distribution is symmetric, 2.5% of the distribution lies 
above Z and 2.5% below —Z. The notation commonly used to denote Z values 
for confidence interval construction or hypothesis testing is Z,/, where 
100(1 — a) is the desired confidence level in percent. For example, if we want 
95% confidence, % = 0.05, 100(1 — %) = 95%, and Zo975=1.96. In hypothesis 
testing the value of & is known as the significance level. 


Example: estimating [1 when o is known 

Suppose that o is known to be 2.8. Assume that we collect a sample ofn = 16 
and compute X = 15.7. Using the above equation we find the 95% confidence 
interval for Las follows: 


X —1.960/Jn <u <X4+1.960//n 


15.7 — 1.96(2.8//16) < pu < 15.7 + 1.96(2.8// 16) 
14.33 < ww < 17.07 


There is a 95% level of confidence associated with this interval. The numbers 
14.33 and 17.07 are sometimes referred to as the confidence limits. 

Note that this is a two-sided confidence interval. There is a 2.5% probability 
that 17.07 is lower than Lt and a 2.5% probability that 14.33 is greater than u. If 
we were only interested in, say, the probability that [1 were greater than 14.33, 
then the one-sided confidence interval would be 1 > 14.33 and the one-sided 
confidence level would be 97.5%. 


Example of using Microsoft Excel to calculate the confidence 


interval for the mean when sigma is known 

Microsoft Excel has a built-in capability to calculate confidence intervals for 
the mean. The dialog box in Figure 9.23 shows the input. The formula result 
near the bottom of the screen gives the interval width as 1.371972758. To find 
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CONFIDENCE 


Alpha [cs “J = 0,05 
Standard_dev [28 *] =2.8 
Size [16 a | = 16 


= 1,371972758 
Returns the confidence interval for a population mean, See Help for the equation used. 


Size is the sample size 
Q) Formula result =1.371972758 Cancel 


Figure 9.23. Example of finding the confidence interval when sigma is known using 
Microsoft Excel. 


the lower confidence limit subtract the width from the mean. To find the upper 
confidence limit add the width to the mean. 


Example: estimating [1 when o is unknown 

When o is not known and we wish to replace 6 with s in calculating confi- 
dence intervals for [l, we must replace Z,/. with t,/. and obtain the percentiles 
from tables for Student’s¢ distribution instead of the normal tables. Let’s revisit 
the example above and assume that instead of knowing 6, it was estimated 
from the sample, that is, based on the sample of n = 16, we computed s = 2.8 
and X = 15.7. Then the 95% confidence interval becomes: 


X =2.131s//n < w<X+2.131s//n 
15.7 — 2.131(2.8/./16) < fu < 15.7 +2.131(2.8/+/16) 
14.21 < uw < 17.19 


It can be seen that this interval is wider than the one obtained for known o. 
The ty. value found for 15 df is 2.131 (see Table 3 in the Appendix), which is 
greater than Z,/. = 1.96 above. 
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Example of using Microsoft Excel to calculate the confidence 


interval for the mean when sigma is unknown 

Microsoft Excel has no built-in capability to calculate confidence intervals 
for the mean when sigma is not known. However, it does have the ability to cal- 
culate t-values when given probabilities and degrees of freedom. This informa- 
tion can be entered into an equation and used to find the desired confidence 
limits. Figure 9.24 illustrates the approach. The formula bar shows the formula 
for the 95% upper confidence limit for the mean in cell B7. 


=$B$1+TINV($B$4 $B$3- 


B $B$2/SQRT($B$3) 

1 Mean 15.7 fl 
2 sigma 2.8 
3 in 16 
4 Alpha 0.05 
5 

Lower Confidence 
6 Limit 14.21 

Upper Confidence 
7 (Limit 17.19 


Figure 9.24. Example of finding the confidence interval when sigma is unknown using 


Microsoft Excel. 


Hypothesis testing/Type | and Type Il errors 


HYPOTHESIS TESTING 


Statistical inference generally involves four steps: 

1. Formulating a hypothesis about the population or “state of nature,” 

2. Collecting a sample of observations from the population, 

3. Calculating statistics based on the sample, 

4. Either accepting or rejecting the hypothesis based on a predetermined 
acceptance criterion. 
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There are two types of error associated with statistical inference: 

Type I error (« error)—The probability that a hypothesis that is actually 
true will be rejected. The value of & is known as the significance level 
of the test. 

Type II error (B error)—The probability that a hypothesis that is actually 
false will be accepted. 

Type II errors are often plotted in what is known as an operating charac- 
teristics curve. 

Confidence intervals are usually constructed as part of a statistical test of 
hypotheses. The hypothesis test is designed to help us make an inference 
about the true population value at a desired level of confidence. We will look 
at a few examples of how hypothesis testing can be used in Six Sigma applica- 
tions. 


Example: hypothesis test of sample mean 

Experiment: The nominal specification for filling a bottle with a test chem- 
ical is 30 cc. The plan is to draw a sample of n=25 units from a stable process 
and, using the sample mean and standard deviation, construct a two-sided confi- 
dence interval (an interval that extends on either side of the sample average) 
that has a 95% probability of including the true population mean. If the inter- 
val includes 30, conclude that the lot mean is 30, otherwise conclude that the 
lot mean is not 30. 

Result: A sample of 25 bottles was measured and the following statistics com- 
puted 


X =28 cc 


s =6 cc 
The appropriate test statistic is t, given by the formula 


_X—pw 28-30 __ 


Sue. ee 


Table 3 in the Appendix gives values for the t statistic at various degrees of 
freedom. There are n — 1 degrees of freedom (df). For our example we need 
the t975 column and the row for 24 df. This gives a t value of 2.064. Since the 
absolute value of this t value is greater than our test statistic, we fail to reject 
the hypothesis that the lot mean is 30 cc. Using statistical notation this is 
shown as: 


t 
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Ho: & = 30 cc (the null hypothesis) 
H;: 1 is not equal to 30 cc (the alternate hypothesis) 
a = .05 (Type I error or level of significance) 
Critical region: —2.064 < ty < +2.064 
Test statistic:t = —1.67. 
Since t lies inside the critical region, fail to reject Ho, and accept the hypoth- 
esis that the lot mean is 30 cc for the data at hand. 


Example: hypothesis test of two sample variances 

The variance of machine X’s output, based ona sample of n = 25 taken froma 
stable process, is 100. Machine Y’s variance, based on a sample of 10, is 50. The 
manufacturing representative from the supplier of machine X contends that 
the result is a mere “statistical fluke.” Assuming that a “statistical fluke” is 
something that has less than 1 chance in 100, test the hypothesis that both 
variances are actually equal. 

The test statistic used to test for equality of two sample variances is the F 
statistic, which, for this example, is given by the equation 


2 
= at = Ee = 2, numerator df = 24, denominator df = 9 
$5 50 

Using Table 5 in the Appendix for F 99 we find that for 24 df in the numerator 
and 9 df in the denominator F = 4.73. Based on this we conclude that the manu- 
facturer of machine X could be right, the result could be a statistical fluke. This 
example demonstrates the volatile nature of the sampling error of sample 
variances and standard deviations. 


Example: hypothesis test of a standard deviation compared to 


a standard value 

A machine is supposed to produce parts in the range of 0.500 inches plus or 
minus 0.006 inches. Based on this, your statistician computes that the absolute 
worst standard deviation tolerable is 0.002 inches. In looking over your capabil- 
ity charts you find that the best machine in the shop has a standard deviation 
of 0.0022, based on a sample of 25 units. In discussing the situation with the sta- 
tistician and management, it is agreed that the machine will be used if a one- 
sided 95% confidence interval on sigma includes 0.002. 
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The correct statistic for comparing a sample standard deviation with a stan- 
dard value is the chi-square statistic. For our data we have s=0.0022, n=25, 
and Og = 0.002. The x statistic has n — 1 = 24 degrees of freedom. Thus, 


2 2 
ges (n ty _ 24x (9.0022) -, 
o (0.002) 
Appendix Table 4 gives, in the 0.05 column (since we are constructing a one- 
sided confidence interval) and the df = 24 row, the critical value x = 36.42. 
Since our computed value of i? is less than 36.42, we use the machine. The 
reader should recognize that all of these exercises involved a number of assump- 
tions, e.g., that we “know” that the best machine has a standard deviation of 
0.0022. In reality, this knowledge must be confirmed by a stable control chart. 


RESAMPLING (BOOTSTRAPPING) 


A number of criticisms have been raised regarding the methods used for esti- 
mation and hypothesis testing: 
e They are not intuitive. 
¢ They are based on strong assumptions (e.g., normality) that are often not 
met in practice. 
e They are difficult to learn and to apply. 
e They are error-prone. 

In recent years a new method of performing these analyses has been devel- 
oped. It is known as resampling or bootstrapping. The new methods are con- 
ceptually quite simple: using the data from a sample, calculate the statistic of 
interest repeatedly and examine the distribution of the statistic. For example, 
say you obtained a sample of n = 25 measurements from a lot and you wished 
to determine a confidence interval on the statistic C,..* Using resampling, you 
would tell the computer to select a sample of n = 25 from the sample results, 
compute C,,,, and repeat the process many times, say 10,000 times. You would 
then determine whatever percentage point value you wished by simply looking 
at the results. The samples would be taken “with replacement,” ie., a particular 
value from the original sample might appear several times (or not at all) in a 
resample. 

Resampling has many advantages, especially in the era of easily available, 
low-cost computer power. Spreadsheets can be programmed to resample and 
calculate the statistics of interest. Compared with traditional statistical meth- 
ods, resampling is easier for most people to understand. It works without strong 


*See Chapter 13. 
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assumptions, and it is simple. Resampling doesn’t impose as much baggage 
between the engineering problem and the statistical result as conventional 
methods. It can also be used for more advanced problems, such as modeling, 
design of experiments, etc. 

For a discussion of the theory behind resampling, see Efron (1982). For a pre- 
sentation of numerous examples using a resampling computer program see 
Simon (1992). 


PRINCIPLES OF STATISTICAL PROCESS CONTROL 


Terms and concepts 


DISTRIBUTIONS 


A central concept in statistical process control (SPC) is that every measur- 
able phenomenon is a statistical distribution. In other words, an observed set 
of data constitutes a sample of the effects of unknown common causes. It fol- 
lows that, after we have done everything to eliminate special causes of varia- 
tions, there will still remain a certain amount of variability exhibiting the state 
of control. Figure 9.25 illustrates the relationships between common causes, 
special causes, and distributions. 
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Figure 9.25. Distributions. 


From Continuing Process Control and Process Capability Improvement, p. 4a. Copyright 


© 1983 by Ford Motor Company. Used by permission of the publisher. 


There are three basic properties of a distribution: location, spread, and 
shape. The /ocation refers to the typical value of the distribution, such as the 
mean. The spread of the distribution is the amount by which smaller values 
differ from larger ones. The standard deviation and variance are measures of 
distribution spread. The shape of a distribution is its pattern—peakedness, 
symmetry, etc. A given phenomenon may have any one of a number of distri- 
bution shapes, e.g., the distribution may be bell-shaped, rectangular-shaped, 
etc. 
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CENTRAL LIMIT THEOREM 


The central limit theorem can be stated as follows: 


Irrespective of the shape of the distribution of the population or universe, 
the distribution of average values of samples drawn from that universe 
will tend toward a normal distribution as the sample size grows without 


bound. 


It can also be shown that the average of sample averages will equal the average 
of the universe and that the standard deviation of the averages equals the stan- 
dard deviation of the universe divided by the square root of the sample size. 
Shewhart performed experiments that showed that small sample sizes were 
needed to get approximately normal distributions from even wildly non-normal 
universes. Figure 9.26 was created by Shewhart using samples of four measure- 
ments. 
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Figure 9.26. Illustration of the central limit theorem. 
From Economic Control of Quality of Manufactured Product, figure 59. Copyright © 1931, 
1980 by ASQC Quality Press. Used by permission of the publisher. 
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The practical implications of the central limit theorem are immense. 
Consider that without the central limit theorem effects, we would have to 
develop a separate statistical model for every non-normal distribution encoun- 
tered in practice. This would be the only way to determine if the system were 
exhibiting chance variation. Because of the central limit theorem we can use 
averages of small samples to evaluate any process using the normal distribution. 
The central limit theorem is the basis for the most powerful of statistical process 
control tools, Shewhart control charts. 


Objectives and benefits 


Without SPC, the bases for decisions regarding quality improvement are 
based on intuition, after-the-fact product inspection, or seat-of-the-pants “data 
analysis.” SPC provides a scientific basis for decisions regarding process 
improvement. 


PREVENTION VERSUS DETECTION 


A process control system is essentially a feedback system that links process 
outcomes with process inputs. There are four main elements involved, the pro- 
cess itself, information about the process, action taken on the process, and 
action taken on the output from the process. The way these elements fit together 
is shown in Figure 9.27. 
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Figure 9.27. A process control system. 
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By the process, we mean the whole combination of people, equipment, 
input materials, methods, and environment that work together to produce 
output. The performance information is obtained, in part, from evaluation 
of the process output. The output of a process includes more than product, 
it also includes information about the operating state of the process such as 
temperature, cycle times, etc. Action taken on a process is future-oriented in 
the sense that it will affect output yet to come. Action on the output is past- 
oriented because it involves detecting out-of-specification output that has 
already been produced. 

There has been a tendency in the past to concentrate attention on the detec- 
tion-oriented strategy of product inspection. With this approach, we wait until 
an output has been produced, then the output is inspected and either accepted 
or rejected. SPC takes you in a completely different direction: improvement in 
the future. A key concept is the smaller the variation around the target, the bet- 
ter. Thus, under this school of thought, it is not enough to merely meet the 
requirements; continuous improvement is called for even if the requirements 
are already being met. The concept of never-ending, continuous improvement 
is at the heart of SPC and Six Sigma. 


Common and special causes of variation 
Shewhart (1931, 1980) defined control as follows: 


A phenomenon will be said to be controlled when, through the use of past 
experience, we can predict, at least within limits, how the phenomenon 
may be expected to vary in the future. Here it is understood that predic- 
tion within limits means that we can state, at least approximately, the 
probability that the observed phenomenon will fall within the given limits. 


The critical point in this definition is that control is not defined as the com- 
plete absence of variation. Control is simply a state where all variation is pre- 
dictable variation. A controlled process isn’t necessarily a sign of good 
management, nor is an out-of-control process necessarily producing non-con- 
forming product. 

In all forms of prediction there is an element of risk. For our purposes, we 
will call any unknown random cause of variation a chance cause or a common 
cause, the terms are synonymous and will be used as such. If the influence of 
any particular chance cause is very small, and if the number of chance causes 
of variation are very large and relatively constant, we have a situation where 
the variation is predictable within limits. You can see from the definition 
above, that a system such as this qualifies as a controlled system. Where Dr. 
Shewhart used the term chance cause, Dr. W. Edwards Deming coined the 
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Figure 9.28. Should these variations be left to chance? 
From Economic Control of Quality of Manufactured Product, p. 13. Copyright © 1931, 1980 by 
ASQC Quality Press. Used by permission of the publisher. 
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Figure 9.29. Types of variation. 
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Figure 9.30. Charts from Figure 9.28 with control limits shown. 
From Economic Control of Quality of Manufactured Product, p. 13. Copyright © 1931, 1980 
by ASQC Quality Press. Used by permission of the publisher. 


term common cause to describe the same phenomenon. Both terms are encoun- 


tered in practice. 


Needless to say, not all phenomena arise from constant systems of common 
causes. At times, the variation is caused by a source of variation that is not part 
of the constant system. These sources of variation were called assignable causes 
by Shewhart, special causes of variation by Deming. Experience indicates that 
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special causes of variation can usually be found without undue difficulty, lead- 
ing to a process that is less variable. 

Statistical tools are needed to help us effectively separate the effects of special 
causes of variation from chance cause variation. This leads us to another defini- 
tion: 


Statistical process control—the use of valid analytical statistical methods to 
identify the existence of special causes of variation in a process. 


The basic rule of statistical process control is: 


Variation from common-cause systems should be left to chance, but 
special causes of variation should be identified and eliminated. 


This is Shewhart’s original rule. However, the rule should not be misinter- 
preted as meaning that variation from common causes should be ignored. 
Rather, common-cause variation is explored “off-line.” That is, we look for 
long-term process improvements to address common-cause variation. 

Figure 9.28 illustrates the need for statistical methods to determine the 
category of variation. 

The answer to the question “should these variations be left to chance?” can 
only be obtained through the use of statistical methods. Figure 9.29 illustrates 
the basic concept. 

In short, variation between the two “control limits” designated by the dashed 
lines will be deemed as variation from the common-cause system. Any variabil- 
ity beyond these fixed limits will be assumed to have come from special causes 
of variation. We will call any system exhibiting only common-cause variation, 
“statistically controlled.” It must be noted that the control limits are not simply 
pulled out of the air, they are calculated from actual process data using valid sta- 
tistical methods. Figure 9.28 is shown below as Figure 9.30, only with the control 
limits drawn on it; notice that process (a) is exhibiting variations from special 
causes, while process (b) is not. This implies that the type of action needed to 
reduce the variability in each case is of a different nature. Without statistical gui- 
dance there could be endless debate over whether special or common causes 
were to blame for variability. 
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Measurement Systems 
Analysis 


R&R STUDIES FOR CONTINUOUS DATA 
Discrimination, stability, bias, repeatability, 
reproducibility, and linearity 

Modern measurement system analysis goes well beyond calibration. A gage 
can be perfectly accurate when checking a standard and still be entirely unac- 
ceptable for measuring a product or controlling a process. This section illus- 
trates techniques for quantifying discrimination, stability, bias, repeatability, 
reproducibility and variation for a measurement system. We also show how to 
express measurement error relative to the product tolerance or the process var- 
iation. For the most part, the methods shown here use control charts. Control 
charts provide graphical portrayals of the measurement processes that enable 
the analyst to detect special causes that numerical methods alone would not 
detect. 


MEASUREMENT SYSTEM DISCRIMINATION 


Discrimination, sometimes called resolution, refers to the ability of the 
measurement system to divide measurements into “data categories.” All 
parts within a particular data category will measure the same. For example, 


Copyright 2003 by The McGraw-Hill Companies, Inc. Click Here for Terms of Use. 
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if a measurement system has a resolution of 0.001 inches, then items measur- 
ing 1.0002, 1.0003, 0.9997 would all be placed in the data category 1.000, i., 
they would all measure 1.000 inches with this particular measurement system. 
A measurement system’s discrimination should enable it to divide the region 
of interest into many data categories. In Six Sigma, the region of interest is 
the smaller of the tolerance (the high specification minus the low specifica- 
tion) or six standard deviations. A measurement system should be able to 
divide the region of interest into at least five data categories. For example, if 
a process was capable (ie., Six Sigma is less than the tolerance) and 
Oo = 0.0005, then a gage with a discrimination of 0.0005 would be acceptable 
(six data categories), but one with a discrimination of 0.001 would not 
(three data categories). When unacceptable discrimination exists, the range 
chart shows discrete “jumps” or “steps.” This situation is illustrated in 
Figure 10.1. 
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Figure 10.1. Inadequate gage discrimination on a control chart. 
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Note that on the control charts shown in Figure 10.1, the data plotted are the 
same, except that the data on the bottom two charts were rounded to the nearest 
25. The effect is most easily seen on the R chart, which appears highly stratified. 
As sometimes happens (but not always), the result is to make the X-bar chart 
go out of control, even though the process is in control, as shown by the control 
charts with unrounded data. The remedy is to use a measurement system cap- 
able of additional discrimination, i.e., add more significant digits. If this cannot 
be done, it is possible to adjust the control limits for the round-off error by 
using a more involved method of computing the control limits, see Pyzdek 
(1992a, pp. 37-42) for details. 


STABILITY 


Measurement system stability is the change in bias over time when using a 
measurement system to measure a given master part or standard. Statistical sta- 
bility is a broader term that refers to the overall consistency of measurements 
over time, including variation from all causes, including bias, repeatability, 
reproducibility, etc. A system’s statistical stability is determined through the 
use of control charts. Averages and range charts are typically plotted on mea- 
surements of a standard or a master part. The standard is measured repeatedly 
over a short time, say an hour; then the measurements are repeated at predeter- 
mined intervals, say weekly. Subject matter expertise is needed to determine 
the subgroup size, sampling intervals and measurement procedures to be fol- 
lowed. Control charts are then constructed and evaluated. A (statistically) stable 
system will show no out-of-control signals on an X-control chart of the averages’ 
readings. No “stability number” is calculated for statistical stability; the system 
either is or is not statistically stable. 

Once statistical stability has been achieved, but not before, measurement sys- 
tem stability can be determined. One measure is the process standard deviation 
based on the R or s chart. 


R chart method: 
wy 
o=— 
d, 
s chart method: 
~ Ss 
a 
C4 


The values d, and c, are constants from Table 11 in the Appendix. 
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BIAS 


Bias is the difference between an observed average measurement result anda 
reference value. Estimating bias involves identifying a standard to represent 
the reference value, then obtaining multiple measurements on the standard. 
The standard might be a master part whose value has been determined by a mea- 
surement system with much less error than the system under study, or by a stan- 
dard traceable to NIST. Since parts and processes vary over a range, bias is 
measured at a point within the range. If the gage is non-linear, bias will not be 
the same at each point in the range (see the definition of linearity above). 

Bias can be determined by selecting a single appraiser and a single reference 
part or standard. The appraiser then obtains a number of repeated measure- 
ments on the reference part. Bias is then estimated as the difference between 
the average of the repeated measurement and the known value of the reference 
part or standard. 


Example of computing bias 

A standard with a known value of 25.4 mm is checked 10 times by one 
mechanical inspector using a dial caliper with a resolution of 0.025 mm. The 
readings obtained are: 


25.425 25.425 25.400 25.400 25.375 
25.400 25.425 25.400 25.425 25.375 


The average is found by adding the 10 measurements together and dividing by 
10, 


- 254.051 
.— = 25.4051 mm 


The bias is the average minus the reference value, ie., 


bias = average — reference value 


= 25.4051 mm — 25.400 mm = 0.0051 mm 


The bias of the measurement system can be stated as a percentage of the toler- 
ance or as a percentage of the process variation. For example, if this mea- 
surement system were to be used on a process with a tolerance of = 0.25 mm 
then 


% bias = 100 x |bias|/tolerance 
= 100 x 0.0051/0.5 = 1% 
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This is interpreted as follows: this measurement system will, on average, pro- 
duce results that are 0.0051 mm larger than the actual value. This difference 
represents 1% of the allowable product variation. The situation is illustrated in 
Figure 10.2. 
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Figure 10.2. Bias example illustrated. 


REPEATABILITY 


A measurement system is repeatable if its variability is consistent. Consistent 
variability is operationalized by constructing a range or sigma chart based on 
repeated measurements of parts that cover a significant portion of the process 
variation or the tolerance, whichever is greater. If the range or sigma chart is 
out of control, then special causes are making the measurement system inconsis- 
tent. If the range or sigma chart is in control then repeatability can be estimated 
by finding the standard deviation based on either the average range or the aver- 
age standard deviation. The equations used to estimate sigma are shown in 
Chapter 9. 


Example of estimating repeatability 

The data in Table 10.1 are from a measurement study involving two inspec- 
tors. Each inspector checked the surface finish of five parts, each part was 
checked twice by each inspector. The gage records the surface roughness in [- 
inches (micro-inches). The gage has a resolution of 0.1 [1-inches. 
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Table 10.1. Measurement system repeatability study data. 


PART |} READING #1 | READING #2 | AVERAGE | RANGE 


INSPECTOR #1 
1 111.9 112.3 112.10 
2 108.1 108.1 108.10 
3 124.9 124.6 124.75 
4 118.6 118.7 118.65 
5 130.0 130.7 130.35 


INSPECTOR #2 


1 111.4 112.9 112.15 1.5 
2 107.7 108.4 108.05 0.7 
3 124.6 124.2 124.40 0.4 
4 120.0 119.3 119.65 0.7 
5 130.4 130.1 130.25 0.3 


We compute: 
Ranges chart 


R=0.51 
UCL = D,R = 3.267 x 0.51 = 1.67 


Averages chart 


X = 118.85 
LCL =X —A,R = 118.85 — 1.88 x 0.109 = 118.65 


UCL = X + A,R = 118.85 + 1.88 x 0.109 = 119.05 
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The data and control limits are displayed in Figure 10.3. The R chart analysis 
shows that all of the R values are less than the upper control limit. This indicates 
that the measurement system’s variability is consistent, ie., there are no special 
causes of variation. 
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Figure 10.3. Repeatability control charts. 


Note that many of the averages are outside of the control limits. This is the 
way it should be! Consider that the spread of the X-bar chart’s control limits is 
based on the average range, which is based on the repeatability error. If the 
averages were within the control limits it would mean that the part-to-part varia- 
tion was less than the variation due to gage repeatability error, an undesirable 
situation. Because the R chart is in control we can now estimate the standard 
deviation for repeatability or gage variation: 


(10.1) 


where d3 is obtained from Table 13 in the Appendix. Note that we are using d} 
and not d>. The d3 values are adjusted for the small number of subgroups typi- 
cally involved in gage R&R studies. Table 13 is indexed by two values: m is the 
number of repeat readings taken (m = 2 for the example), and g is the number 
of parts times the number of inspectors (g = 5 x 2 = 10 for the example). 
This gives, for our example 


R051 ai 
O. = — ie 
S ria elle 
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The repeatability from this study is calculated by 5.150, = 5.15x 
0.44 = 2.26. The value 5.15 is the Z ordinate which includes 99% of a standard 
normal distribution. 


REPRODUCIBILITY 


A measurement system is reproducible when different appraisers produce 
consistent results. Appraiser-to-appraiser variation represents a bias due to 
appraisers. The appraiser bias, or reproducibility, can be estimated by com- 
paring each appraiser’s average with that of the other appraisers. The standard 
deviation of reproducibility (o,) is estimated by finding the range between 
appraisers (R,) and dividing by d}. Reproducibility is then computed as 5.150. 


Reproducibility example (AIAG method) 
Using the data shown in the previous example, each inspector’s average is 
computed and we find: 


Inspector ##1 average = 118.79 1-inches 
Inspector #2 average = 118.90 j1-inches 
Range = R, = 0.11 u-inches 


Looking in Table 13 in the Appendix for one subgroup of two appraisers we 
find d; = 1.41 (m = 2,g = 1), since there is only one range calculation g = 1. 
Using these results we find R,/d; = 0.11/1.41 = 0.078. 

This estimate involves averaging the results for each inspector over all of the 
readings for that inspector. However, since each inspector checked each part 
repeatedly, this reproducibility estimate includes variation due to repeatability 
error. The reproducibility estimate can be adjusted using the following equa- 


tion: 
R,\’ (5.150,) 0.11\7 (5.15 x 0.44)? 
5.152) — = /(5.15 x = 
a nr 1.41 5 ee 


= /0.16 — 0.51 =0 


As sometimes happens, the estimated variance from reproducibility exceeds 
the estimated variance of repeatability + reproducibility. When this occurs the 
estimated reproducibility is set equal to zero, since negative variances are the- 
oretically impossible. Thus, we estimate that the reproducibility is zero. 
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The measurement system standard deviation is 


On, = Vo2+o2 =,/ (0.44) +0 =0.44 (10.2) 


and the measurement system variation, or gage R&R, is 5.150,,. For our data 
gace R&R =5.15 X 0.44 = 2.27. 


Reproducibility example (alternative method) 

One problem with the above method of evaluating reproducibility error is 
that it does not produce a control chart to assist the analyst with the evaluation. 
The method presented here does this. This method begins by rearranging the 
data in Table 10.1 so that all readings for any given part become a single row. 
This is shown in Table 10.2. 


Table 10.2. Measurement error data for reproducibility evaluation. 


INSPECTOR #1 INSPECTOR #2 
Part | Reading 1 | Reading 2 
1 111.9 112.3 112.9 112.125 
2 108.1 108.1 108.4 108.075 
3 124.9 124.6 124.2 124.575 
4 118.6 118.7 119.3 119.15 
5 130 130.7 130.1 130.3 
Averages > | 118.845 


Observe that when the data are arranged in this way, the R value measures the 
combined range of repeat readings plus appraisers. For example, the smallest 
reading for part #43 was from inspector ##2 (124.2) and the largest was from 
inspector FH (124.9). Thus, R represents two sources of measurement error: 
repeatability and reproducibility. 
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The control limits are calculated as follows: 
Ranges chart 


R = 1.00 
UCL = D,R = 2.282 x 1.00 = 2.282 


Note that the subgroup size is 4. 


Averages chart 


X = 118.85 
LCL =X —A,R = 118.85 — 0.729 x 1 = 118.12 
UCL =X +A,R = 118.85 +0.729 x 1 = 119.58 


The data and control limits are displayed in Figure 10.4. The R chart analysis 
shows that all of the R values are less than the upper control limit. This indicates 
that the measurement system’s variability due to the combination of repeatabil- 
ity and reproducibility is consistent, i.e., there are no special causes of variation. 
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Figure 10.4. Reproducibility control charts. 


Using this method, we can also estimate the standard deviation of repro- 
ducibility plus repeatability, as we can find 0, = R,/d; = 1/2.08 = 0.48. 
Now we know that variances are additive, so 


2: 2 2 
Oepeatability+-reproducibility = Yrepeatability a O;eproducibility (10.3) 
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which implies that 


—_ 2 _ 72 
Or eproducibility _ ‘f © epeatability--reproducibility Oepeatability 


In a previous example, we computed O;erearability = 0.44. Substituting these 
values gives 


3 2 — 8 
Or eproducibility _ af © epeatability-+-reproducibility Oepeatability 


= f (0.48)° — (0.44)" = 0.19 


Using this we estimate reproducibility as 5.15 x 0.19 = 1.00. 


PART-TO-PART VARIATION 


The X-bar charts show the part-to-part variation. To repeat, if the measure- 
ment system is adequate, most of the parts will fall outside of the X -bar chart con- 
trol limits. If fewer than half of the parts are beyond the control limits, then 
the measurement system is not capable of detecting normal part-to-part vari- 
ation for this process. 

Part-to-part variation can be estimated once the measurement process is 
shown to have adequate discrimination and to be stable, accurate, linear (see 
below), and consistent with respect to repeatability and reproducibility. If the 
part-to-part standard deviation is to be estimated from the measurement system 
study data, the following procedures are followed: 

1. Plot the average for each part (across all appraisers) on an averages con- 

trol chart, as shown in the reproducibility error alternate method. 

2. Confirm that at least 50% of the averages fall outside the control limits. If 
not, find a better measurement system for this process. 

3. Find the range of the part averages, R,. 

4. Compute o, = R,/d), the part-to-part standard deviation. The value of 
d> is found in Table 13 in the Appendix using m = the number of parts 
and g = 1, since there is only one R calculation. 

5. The 99% spread due to part-to-part variation (PV) is found as 5.150,. 


Once the above calculations have been made, the overall measurement sys- 
tem can be evaluated. 
1. The total process standard deviation is found as 0, = ,/o%, + Gre Where 
O,, = the standard deviation due to measurement error. 


2. Total variability (TV) is 5.159,. 
3. The percent repeatability and reproducibility (R&R) is 100 x (,,/0,)%. 
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4. Thenumber of distinct data categories that can be created with this mea- 
surement system is 1.41 x (PV/R&R). 


EXAMPLE OF MEASUREMENT SYSTEM ANALYSIS 
SUMMARY 


1. Plot the average for each part (across all appraisers) on an averages con- 

trol chart, as shown in the reproducibility error alternate method. 
Done above, see Figure 10.3. 

2. Confirm that at least 50% of the averages fall outside the control limits. If 
not, find a better measurement system for this process. 

4 of the 5 part averages, or 80%, are outside of the control limits. Thus, 
the measurement system error is acceptable. 

3. Find the range of the part averages, R,. 

Ry, = 130.3 — 108.075 = 22.23. 

4, Compute Op = Ry} Le the part-to-part standard deviation. The value of 
d> is found in Table 13 in the Appendix using m = the number of parts 
and g = 1, since there is only one R calculation. 

m =5,g = 1,d3 = 2.48, 0, = 22.23/2.48 = 8.%. 
5. The 99% spread due to part-to-part eanaaon (PV) is found as 5.150,,. 
5.15 X 8.96 = PV = 46.15. 


Once the above calculations have been made, the overall measurement sys- 
tem can be evaluated. 


1. The total process standard deviation is found as 0, = ,/07, + G5 


OpS4)o7 eS ‘ (0.44)° + (8.96)° = /80.5 = 8.97 
2. Total variability (TV) is 5.150,. 
5.15 x 8.97 = 46.20 


3. The percent R&R is 100 x (6,,/0,)% 


Own 0.44 
100 —% = 100 —— = 4.91% 
8.97 


O; 


4. Thenumber of distinct data categories that can be created with this mea- 
surement system is 1.41 x (PV/R&R). 


46.15 
1.41 x —— = 28.67 = 28 
2.27 
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Since the minimum number of categories is five, the analysis indicates that 
this measurement system is more than adequate for process analysis or process 
control. 


Gage R&R analysis using Minitab 
Minitab has a built-in capability to perform gage repeatability and reproduci- 
bility studies. To illustrate these capabilities, the previous analysis will be 
repeated using Minitab. To begin, the data must be rearranged into the format 
expected by Minitab (Figure 10.5). For reference purposes, columns C1—C4 
contain the data in our original format and columns C5—C8 contain the same 
data in Minitab’s preferred format. 


‘ ci c2 c3 c4 cs C6-T c7 ce 


Part Reading! Reading? inspector StackedData Subscripts Operator PartNum 
1 1 1119 112.3 1 1119 Reading! 1 
2 08 | 108 1 1 108 1 Reading! 2 
3 K 1249 46 1 124 9 Reading! 3 
a - 118.6 187 | 118 6 Reading! - 
5 5 130.0 30.7 1 130.0 Reading! 5 
6 1 Wis 1129 2 1114 Reading! 2 
7 2 107 7 108 4 2 107 7 Reading! 2 2 
8 3 124 6 124 2 2 124 6 Reading! 2 3 
$ ~ 120.6 119 2 120.0 Reading! 2 - 
10 § 130.4 130.1 2 130.4 Reading! 2 5 
1 112.3 Reading? 1 1 
12 108 1 Reading? 1 2 
3 124 6 Reading? | 3 
14 118 7 Reading? 1 4 
15 130.7 Reading? 1 5 
16 112 9 Reading? 2 1 
17 108 4 Reading? 2 2 
18 124 2 Reading? 2 3 
19 119. 3 Reading? 2 4 
20 130 1 Reading? 2 5 


Figure 10.5. Data formatted for Minitab input. 


Minitab offers two different methods for performing gage R&R studies: 
crossed and nested. Use gage R&R nested when each part can be measured by 
only one operator, as with destructive testing. Otherwise, choose gage R&R 
crossed. To do this, select Stat > Quality Tools > Gage R&R Study (Crossed) 
to reach the Minitab dialog box for our analysis (Figure 10.6). In addition to 
choosing whether the study is crossed or nested, Minitab also offers both the 
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Gage R&R Study (Crossed) x| 


Part Part numbers: PartNum Gage Info... | 
Readingl 

Reading2 Operators: Operator 

Inspector Options... | 
StackedData Measurement data: |StackedData 

subscripts 

Operator 

PartNum 


Method of Analysis 


© Xbar and R 
Select | OK 


Help Cancel | 


Figure 10.6. Minitab gage R&R (crossed) dialog box. 


ANOVA and the X-bar and R methods. You must choose the ANOVA option 
to obtain a breakdown of reproducibility by operator and operator by part. If 
the ANOVA method is selected, Minitab still displays the X-bar and R charts 
so you won't lose the information contained in the graphics. We will use 
ANOVA in this example. Note that the results of the calculations will differ 
slightly from those we obtained using the X-bar and R methods. 

There is an option in gage R&R to include the process tolerance. This will 
provide comparisons of gage variation with respect to the specifications in addi- 
tion to the variability with respect to process variation. This is useful informa- 
tion if the gage is to be used to make product acceptance decisions. If the 
process is “capable” in the sense that the total variability is less than the toler- 
ance, then any gage that meets the criteria for checking the process can also be 
used for product acceptance. However, if the process is not capable, then its out- 
put will need to be sorted and the gage used for sorting may need more discrimi- 
natory power than the gage used for process control. For example, a gage 
capable of 5 distinct data categories for the process may have 4 or fewer for the 
product. For the purposes of illustration, we entered a value of 40 in the process 
tolerance box in the Minitab options dialog box (Figure 10.7). 


Output 


Minitab produces copious output, including six separate graphs, multiple 
tables, etc. Much of the output is identical to what has been discussed earlier in 
this chapter and won’t be shown here. 
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992 


Gage R&R Study (Crossed) - Options . 


Study variation: [5.15 
Process tolerance: [40 
Historical sigma: 


- Do not display percent contribution 
Do not display percent study variation 


- Draw plots on separate pages, one plot per page 


Title: [Gage RSF Example 


Help 


x| 


(number of standard deviations) 


Figure 10.7. Minitab gage R&R (crossed) options dialog box. 


Table 10.3 shows the analysis of variance for the R&R study. In the ANOVA 
the MS for repeatability (0.212) is used as the denominator or error term for cal- 
culating the F-ratio of the Operator*PartNum interaction; 0.269/0.212 = 1.27. 
The F-ratio for the Operator effect is found by using the Operator*PartNum 
interaction MS term as the denominator, 0.061/0.269 = 0.22. The F-ratios are 
used to compute the P values, which show the probability that the observed var- 
iation for the source row might be due to chance. By convention, a P value less 
than 0.05 is the critical value for deciding that a source of variation is “signifi- 


Table 10.3. Two-way ANOVA table with interaction. 


Source DF | SS MS F P 
Operator 1 0.06 0.061 0.22 0.6602 
Operator*PartNum | 4 1.08 0.269 1.27 | 0.34317 
Repeatability 10 2.12 0.212 

Total 19 | 1304.43 
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cant,” ie., greater than zero. For example, the P value for the PartNum row is 0, 
indicating that the part-to-part variation is almost certainly not zero. The P 
values for Operator (0.66) and the Operator*PartNum interaction (0.34) are 
greater than 0.05 so we conclude that the differences accounted for by these 
sources might be zero. If the Operator term was significant (P < 0.05) we 
would conclude that there were statistically significant differences between 
operators, prompting an investigation into underlying causes. If the interaction 
term was significant, we would conclude that one operator has obtained differ- 
ent results with some, but not all, parts. 

Minitab’s next output is shown in Table 10.4. This analysis has removed the 
interaction term from the model, thereby gaining 4 degrees of freedom for the 
error term and making the test more sensitive. In some cases this might identify 
a significant effect that was missed by the larger model, but for this example 
the conclusions are unchanged. 


Table 10.4. Two-way ANOVA table without interaction. 


Source DF SS MS F P 
PartNum 4 |) 1301.18 | 325.294 | 1426.73 | 0 
Operator 1 0.06 0.061 0.27 | 0.6145 
Repeatability | 14 3.19 0.228 

Total 19 | 1304.43 


Minitab also decomposes the total variance into components, as shown in 
Table 10.5. The VarComp column shows the variance attributed to each source, 
while the % of VarComp shows the percentage of the total variance accounted 
for by each source. The analysis indicates that nearly all of the variation is 
between parts. 

The variance analysis shown in Table 10.5, while accurate, is not in original 
units. (Variances are the squares of measurements.) Technically, this is the cor- 
rect way to analyze information on dispersion because variances are additive, 
while dispersion measurements expressed in original units are not. However, 
there is a natural interest in seeing an analysis of dispersion in the original 
units so Minitab provides this. Table 10.6 shows the spread attributable to the 
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Table 10.5. Components of variance analysis. 


Source VarComp % of VarComp 
Total gage R&R 0.228 0.28 
Repeatability 0.228 0.28 
Reproducibility 0 0 
Operator 0 0) 
Part-to-Part 81.267 99.72 
Total Variation 81.495 100 


different sources. The StdDev column is the standard deviation, or the square 
root of the VarComp column in Table 10.5. The Study Var column shows the 
99% confidence interval using the StdDev. The % Study Var column is the 
Study Var column divided by the total variation due to all sources. And the % 
Tolerance is the Study Var column divided by the tolerance. It is interesting 
that the % Tolerance column total is greater than 100%. This indicates that the 
measured process spread exceeds the tolerance. Although this isn’t a process 
capability analysis, the data do indicate a possible problem meeting tolerances. 
The information in Table 10.6 is presented graphically in Figure 10.8. 


Linearity 
Linearity can be determined by choosing parts or standards that cover all or 
most of the operating range of the measurement instrument. Bias is determined 
at each point in the range and a linear regression analysis is performed. 
Linearity is defined as the slope times the process variance or the slope times 
the tolerance, whichever is greater. A scatter diagram should also be plotted 
from the data. 


LINEARITY EXAMPLE 


The following example is taken from Measurement Systems Analysis, pub- 
lished by the Automotive Industry Action Group. 
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Table 10.6. Analysis of spreads. 


Study % 
Var % Study Var Tolerance 
Source StdDev | (5.15*SD) (%SV) (SV/Toler) 
Total gage R&R | 0.47749 2.4591 5.29 6.15 
Repeatability 0.47749 2.4591 5.29 6.15 
Reproducibility | 0 0 0 0 
Operator 0) 0 0) 0) 
Part-to-Part 9.0148 46.4262 99.86 116.07 
Total Variation 9.02743 46.4913 100 116.23 
Gage name: 
Gage R&R Example eee 
ieee 
Components of Variation 
120 7 = = =%Contribution 
mM %Study Var 
100 ~| HZ %Tolerance 
80 7 
< 
® 
2! 260-= 7 
® 
oO 
40 — 
20 7 


Gage R&R 


Repeat 


Reprod 


Part-to-Part 


Figure 10.8. Graphical analysis of components of variation. 


R&R studies for continuous data 343 


A plant foreman was interested in determining the linearity of a measure- 
ment system. Five parts were chosen throughout the operating range of the mea- 
surement system based upon the process variation. Each part was measured by 
a layout inspection to determine its reference value. Each part was then mea- 
sured twelve times by a single appraiser. The parts were selected at random. 
The part average and bias average were calculated for each part as shown in 
Figure 10.9. The part bias was calculated by subtracting the part reference 
value from the part average. 


PART > 1 2 3 4 5 

Average 2.49 4.13 6.03 7.71 9.38 
Ref. Value 2.00 4.00 6.00 8.00 10.00 
Bias +0.49 +0.13 +0.03 -0.29 -0.62 


Figure 10.9. Gage data summary. 


A linear regression analysis was performed. In the regression, x is the refer- 
ence value and y is the bias. The results are shown in Figure 10.10. 


SUMMARY OUTPUT 


Regression statistics 
Multiple R 


df 5S ms F i Significance F 


_ Regression ae 0.69696 0.69696 131.336683 0.00142598 
Residual 001592 0.00530667 2 
Total 4 i 0.71288 
Contents (Standard ever, tSat | Prats | 
Intercept 0.74 “porei024a ao 9.68555413 | 0.002337) 2 
Ref. Value -0.132 | 0. 0115181 “11460222 0.00142598 | 


Figure 10.10. Regression analysis of linearity summary data. 
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The P-values indicate that the result is statistically significant, ie., there is 
actually a bias in the gage. The slope of the line is —0.132, and the intercept is 
0.74. R° = 0.98, indicating that the straight line explains about 98% of the varia- 
tion in the bias readings. The results can be summarized as follows: 


Bias b + ax = 0.74 — 0.132 (Reference Value) 
Linearity |slope| x Process Variation = 0.132 x 6 = 0.79, where 6 is the 
tolerance 


% Linearity 100% x |slope| = 13.2% 


Note that the zero bias point is found at 


intercept 0.74 
x = —]| —— ] =- = 5.61 
slope —0.132 
In this case, this is the point of least bias. Greater bias exists as you move 


further from this value. 
This information is summarized graphically in Figure 10.11. 


BIAS 
1.0 [- 


0.5 ae 


0.0 


0.74 - 0.132 (REF. VALUE) 


| REF, VALUE 


O05 POINT OF ZERO BIAS 


Figure 10.11. Graphical analysis of linearity. 
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LINEARITY ANALYSIS USING MINITAB 


Minitab has a built-in capability to perform gage linearity analysis. Figure 
10.12 shows the data layout and dialog box. Figure 10.13 shows the Minitab out- 
put. 

Note that Minitab doesn’t show the P-values for the analysis so it is necessary 
to perform a supplementary regression analysis anyway to determine the statis- 
tical significance of the results. For this example, it is obvious from the scatter 
plot that the slope of the line isn’t zero, so a P-value isn’t required to conclude 
that non-linearity exists. The results aren’t so clear for bias, which is only 
0.867%. In fact, if we perform a one-sample ¢t test of the hypothesis that the 
mean bias is 0, we get the results shown in Figure 10.14, which indicate the bias 
could be 0 (P = 0.797).* 


C1 c2 = a cs cé C7 ce | c9 c10 
PART Average Reference bias 
t 249 > 149 

413 4 i 


> ®.02 0 9.UD 


Goge Linearity and Bias Study = 


x! 
7) PA 2 1 Part numbers; x= 8 Gage Info... 
C2 Average 
C3 Reference Master measurements: Seference ; 
C4 bios — — Options... | 
Measurement data: jAverage 
Process Variation: | 


(study variation from Gage RR) 
or 
(6*historical siqma) 


OK 


Help Cancel | 


Figure 10.12. Minitab gage linearity dialog box. 


*A problem with this analysis is that the datum for each part is an average of twelve measurements, not individual measure- 
ments. If we could obtain the 60 actual measurements the P-value would probably be different because the standard error 
would be based on 60 measurements rather than five. On the other hand, the individual measurements would also be more 


variable, so the exact magnitude of the difference is impossible to determine without the raw data. 
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Gage name: 
A 7 . Date of study: 
Gage Linearity Analysis Reported by: 
Tolerance: 
Misc: 
Gage Linearity 
Linearity: 0.792 
oS %Linearity: 13.200 
R-Squared: 0.978 
Gage Bias 
Bias: -0.052 
® %Bias: 0.867 
wn 
2 0.0 4 ® 
Percent of Process Variation 
14 7 
42°) 
40.9 
05 4 2 
a °] 
® aa 
T T T T T T T T T 
| 
2 : 4 2 o fs ‘3 sg ae Seas] 
Master Part Measurement y y 
Linearity Bias 


Figure 10.13. Minitab gage linearity output. 


One-Sample T: bias 
Test of mu « O vs mu not = 0 


Variable N Mean 
bias 5 -0.052 


Variable 95.0% CI 


bias { -~0.576, 0. 


Figure 10.14. One-sample t-test of bias. 


ATTRIBUTE MEASUREMENT ERROR ANALYSIS 


Attribute data consist of classifications rather than measurements. 
Attribute inspection involves determining the classification of an item, e.g,, is 
. ce ” ce ” . . . . 
it “good” or “bad”? The principles of good measurement for attribute inspec- 
tion are the same as for measurement inspection (Table 10.7). Thus, it is possi- 
ble to evaluate attribute measurement systems in much the same way as we 
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evaluate variable measurement systems. Much less work has been done on 
evaluating attribute measurement systems. The proposals provided in this 
book are those I’ve found to be useful for my employers and clients. The 
ideas are not part of any standard and you are encouraged to think about 
them critically before adopting them. I also include an example of Minitab’s 
attribute gage R&R analysis. 


Table 10.7. Attribute measurement concepts. 


Reproducibility 


Measurement Interpretation for 

Concept Attribute Data Suggested Metrics and Comments 

Accuracy Items are correctly Number of times correctly classified by all 
categorized. Total number of evaluations by all 

Requires knowledge of the “true” value. 

Bias The proportion of | Overall average proportion in a given category (for all 
items in a given inspectors) minus correct proportion ina given 
category iscorrect. | category. Averaged over all categories. 

Requires knowledge of the “true” value. 

Repeatability When aninspector | Fora given inspector: 


evaluates the same 
item multiple 
times inashort 
time interval, she 
assigns it to the 


same category 
every time. 


When all 


inspectors evaluate 


the same item, 
they all assign it to 
the same category. 


Total number of times repeat classifications agree 


Total number of repeat classifications 


Overall: Average of repeatabilities 


Total number of times classifications for all concur 


Total number of classifications 


Continued on next page... 
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Table 10.7 (cont. ) 


Measurement Interpretation for 
Concept Attribute Data Suggested Metrics and Comments 


Stability The variability Metric Stability Measure for Metric 
between attribute 
R&R studies at Repeatability Standard deviation of 


different times. repeatabilities 


Reproducibility | Standard deviation of 
reproducibilities 


Accuracy Standard deviation of accuracies 


Bias Average bias 


“Linearity” When an inspector | Range of inaccuracy and bias across all categories. 
evaluates items 
covering the full Requires knowledge of the “true” value. 
set of categories, 
her classifications Note: Because there is no natural ordering for 
are consistent nominal data, the concept of linearity doesn’t really 
across the have a precise analog for attribute data on this scale. 
categories. However, the suggested metrics will highlight 

interactions between inspectors and specific categories. 


Operational definitions 
An operational definition is defined as a requirement that includes a means 
of measurement. “High quality solder” is a requirement that must be operatio- 
nalized by a clear definition of what “high quality solder” means. This might 
include verbal descriptions, magnification power, photographs, physical com- 
parison specimens, and many more criteria. 


EXAMPLES OF OPERATIONAL DEFINITIONS 


1. Operational definition of the Ozone Transport Assessment Group’s 
(OTAG) goal 

Goal: To identify reductions and recommend transported ozone 

and its precursors which, in combination with other measures, will 

enable attainment and maintenance of the ozone standard in the 


OTAG region. 
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Suggested operational definition of the goal: 

1. A general modeled reduction in ozone and ozone precursors 
aloft throughout the OTAG region; and 

2. A reduction of ozone and ozone precursors both aloft and at 
ground level at the boundaries of non-attainment area modeling 
domains in the OTAG region; and 

3. A minimization of increases in peak ground level ozone concen- 
trations in the OTAG region. (This component of the opera- 
tional definition is in review.) 

2. Wellesley College Child Care Policy Research Partnership operational 
definition of unmet need 

1. Standard of comparison to judge the adequacy of neighborhood ser- 
vices: the median availability of services in the larger region 
(Hampden County). 

2. Thus, our definition of unmet need: The difference between the care 
available in the neighborhood and the median level of care in the sur- 
rounding region (stated in terms of child care slots indexed to the 
age-appropriate child population—“slots-per-tots”’). 

3. Operational definitions of acids and bases 

1. Andacid is any substance that increases the concentration of the H* 
ion when it dissolves in water. 

2. Abase is any substance that increases the concentration of the OH 
ion when it dissolves in water. 

4. Operational definition of “intelligence” 

1. Administer the Stanford-Binet IQ test to a person and score the 

result. The person’s intelligence is the score on the test. 
5. Operational definition of “dark blue carpet” 
A carpet will be deemed to be dark blue if 

1. Judged by an inspector medically certified as having passed the U.S. 
Air Force test for color-blindness 
1.1. Itmatches the PANTONE color card 7462 C when both carpet 

and card are illuminated by GE “cool white” fluorescent tubes; 
1.2. Card and carpet are viewed at a distance between 16 inches and 
24 inches. 


HOW TO CONDUCT ATTRIBUTE INSPECTION 
STUDIES 


Some commonly used approaches to attribute inspection analysis are shown 
in Table 10.8. 
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Table 10.8. Methods of evaluating attribute inspection. 


True Value | Method of Evaluation Comments 

Metrics: 
Percent correct 
Quantifies the accuracy of the 
classifications. 

Expert Judgment: An Simple to evaluate. 

expert looks at the 2 

eae Who says the expert is correct? 

classifications after the 

operator makes normal Care must be taken to include all types of 

classifications and decides attributes. 

which are correct and : 3 

a Difficult to compare operators since 

which are incorrect. : ; : : 
different units are classified by different 
people. 
Acceptable level of performance must be 
decided upon. Consider cost, impact on 
customers, etc. 

Know Metrics: 


Round Robin Study: A set 
of carefully identified 
objects is chosen to 
represent the full range of 
attributes. 


1. Each item is evaluated 
by an expert and its 
condition recorded. 

2. Each item is evaluated 
by every inspector at 
least twice. 


1. Percent correct by inspector 
2. Inspector repeatability 

3. Inspector reproducibility 

4. Stability 

5. Inspector “linearity” 


Full range of attributes included. 


All aspects of measurement error 


quantified. 


People know they’ re being watched, may 
affect performance. 


Not routine conditions. 
Special care must be taken to insure rigor. 


Acceptable level of performance must be 
decided upon for each type of error. 
Consider cost, impact on customers, etc. 


Continued on next page... 
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Table 10.8. (cont.) 
True Value | Method of Evaluation Comments 
Metrics: 
1. Inspector repeatability 
2. Inspector reproducibility 
3. Stability 
4. Inspector “linearity” 
Like a round robin, except true value isn’t 
Inspector Concurrence 
known. 
Study: A set of carefully 
identified objects is No measures of accuracy or bias are 
chosen to represent the possible. Can only measure agreement 
Unknown | full range of attributes, to between equally qualified people. 


the extent possible. 


1. Each item is evaluated 
by every inspector at 
least twice. 


Full range of attributes included. 


affect performance. 


Not routine conditions. 


decided upon for each type of error. 


Consider cost, impact on customers, etc. 


People know they’re being watched, may 


Acceptable level of performance must be 


Special care must be taken to insure rigor. 


Example of attribute inspection error analysis 


Two sheets with identical lithographed patterns are to be inspected under 
carefully controlled conditions by each of the three inspectors. Each sheet has 
been carefully examined multiple times by journeymen lithographers and they 
have determined that one of the sheets should be classified as acceptable, the 
other as unacceptable. The inspectors sit on a stool at a large table where the 
sheet will be mounted for inspection. The inspector can adjust the height of 
the stool and the angle of the table. A lighted magnifying glass is mounted to 
the table with an adjustable arm that lets the inspector move it to any part of 
the sheet (see Figure 10.15). 
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Figure 10.15. Lithography inspection station table, stool and magnifying glass. 


Each inspector checks each sheet once in the morning and again in the after- 
noon. After each inspection, the inspector classifies the sheet as either accepta- 
ble or unacceptable. The entire study is repeated the following week. The 


results are shown in Table 10.9. 


Table 10.9. Results of lithography attribute inspection study. 


A B C D E F G H I 
Part | Standard |InspA | InspB | InspC | Date Time Reproducible | Accurate 
1 1 1 1 1 Today Morning 1 1 
0 1 1 Today Afternoon 0 0 
0 0 0 | Today Morning 1 0 
0 0 1 Today Afternoon 0 0 
1 1 1 LastWeek | Morning 1 if 
1 1 0 LastWeek | Afternoon 0 0 
0 0 1 LastWeek | Morning 0 0 
0 0 0 LastWeek | Afternoon 1 0 
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In Table 10.9 the Part column identifies which sheet is being inspected, and 
the Standard column is the classification for the sheet based on the journey- 
men’s evaluations. A 1 indicates that the sheet is acceptable, a 0 that it is unac- 
ceptable. The columns labeled InspA, InspB, and InspC show the 
classifications assigned by the three inspectors respectively. The Reproducible 
column isa 1 ifall three inspectors agree on the classification, whether their clas- 
sification agrees with the standard or not. The Accurate column is a 1 if all 
three inspectors classify the sheet correctly as shown in the Standard column. 


INDIVIDUAL INSPECTOR ACCURACY 


Individual inspector accuracy is determined by comparing each inspector’s 
classification with the Standard. For example, in cell C2 of Table 10.9 
Inspector A classified the unit as acceptable, and the standard column in the 
same row indicates that the classification is correct. However, in cell C3 the 
unit is classified as unacceptable when it actually is acceptable. Continuing 
this evaluation shows that Inspector A made the correct assessment 7 out of 8 
times, for an accuracy of 0.875 or 87.5%. The results for all inspectors are given 
in Table 10.10. 


Table 10.10. Inspector accuracies. 


Inspector A B C 


Accuracy 87.5% | 100.0% | 62.5% 


Repeatability and pairwise reproducibility 

Repeatability is defined in Table 10.7 as the same inspector getting the same 
result when evaluating the same item more than once within a short time inter- 
val. Looking at InspA we see that when she evaluated Part 1 in the morning of 
“Today” she classified it as acceptable (1), but in the afternoon she said it was 
unacceptable (0). The other three morning/afternoon classifications matched 
each other. Thus, her repeatability is 3/4 or 75%. 

Pairwise reproducibility is the comparison of each inspector with every other 
inspector when checking the same part at the same time on the same day. For 
example, on Part 1/Morning/Today, InspA’s classification matched that of 
InspB. However, for Part 1/Afternoon/Today InspA’s classification was differ- 
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ent than that of InspB. There are eight such comparisons for each pair of inspec- 
tors. Looking at InspA versus InspB we see that they agreed 7 of the 8 times, 
for a pairwise repeatability of 7/8 = 0.875. 

In Table 10.11 the diagonal values are the repeatability scores and the off- 
diagonal elements are the pairwise reproducibility scores. The results are 
shown for “Today”, “Last Week” and both combined. 


Table 10.11. Repeatability and pairwise reproducibility for both days combined. 


Overall Today Last Week 


A B C A B C A B C 
A | 0.75) 0.88] 0.50 A A 
B 1.00} 0.50 B 1.00} 0.75 B 1.00] 0.50 
C 0.25 C 0.50 C 0.00 


OVERALL REPEATABILITY, REPRODUCIBILITY, 
ACCURACY AND BIAS 

Information is always lost when summary statistics are used, but the data 
reduction often makes the tradeoff worthwhile. The calculations for the overall 
statistics are operationally defined as follows: 
Repeatability is the average of the repeatability scores for the two days 
combined; ie., (0.75 + 1.00 + 0.25)/3 = 0.67. 
Reproducibility is the average of the reproducibility scores for the two 
days combined (see Table 10.9); ie., 


Gare ee) | 
SSS 2 = 0.50 


4 4 


Accuracy is the average of the accuracy scores for the two days combined 
(see Table 10.9); ie., 


ee OO" ae OsO 6 
(epee eee) [a 028 


4 4 
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Bias is the estimated proportion in a category minus the true proportion in 
the category. In this example the true percent defective is 50% (1 part in 
2). Of the twenty-four evaluations, twelve evaluations classified the item 
as defective. Thus, the bias is 0.5 — 0.5 = 0. 


OVERALL STABILITY 
Stability is calculated for each of the above metrics separately, as shown in 
Table 10.12. 


Table 10.12. Stability analysis. 


Stability 
Stability of ... Operational Definition of Stability Result 
Repeatability Standard deviation of the six repeatabilities (0.5, 1, 0.5, 1, 1, 1) 0.41 


Reproducibility | Standard deviation of the average repeatabilities. For data in 
Table 10.9, =STDEV(AVERAGE(H2:H5),AVERAGE(H6:H9)) | 0.00 


Accuracy Standard deviation of the average accuracies. For data in Table 
10.9, =STDEV(AVERAGE(I2:15),AVERAGE(16:19)) 0.00 
Bias Average of bias over the two weeks 0.0 


INTERPRETATION OF RESULTS 


1. The system overall appears to be unbiased and accurate. However, the 
evaluation of individual inspectors indicates that there is room for 
improvement. 

2. The results of the individual accuracy analysis indicate that Inspector C 
has a problem with accuracy, see Table 10.10. 

3. The results of the R&R (pairwise) indicate that Inspector C has a pro- 
blem with both repeatability and reproducibility, see Table 10.11. 

4. The repeatability numbers are not very stable (Table 10.12). Comparing 
the diagonal elements for Today with those of Last Week in Table 
10.11, we see that Inspectors A and C tended to get different results for 
the different weeks. Otherwise the system appears to be relatively stable. 

5. Reproducibility of Inspectors A and B is not perfect. Some benefit might 
be obtained from looking at reasons for the difference. 
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6. Since Inspector B’s results are more accurate and repeatable, studying 
her might lead to the discovery of best practices. 


Minitab attribute gage R&R example 

Minitab includes a built-in capability to analyze attribute measurement sys- 
tems, known as “attribute gage R&R.” We will repeat the above analysis using 
Minitab. 

Minitab can’t work with the data as shown in Table 10.9, it must be rear- 
ranged. Once the data are in a format acceptable to Minitab, we enter the 
Attribute Gage R&R Study dialog box by choosing Stat > Quality Tools > 
Attribute Gage R&R Study (see Figure 10.16). Note the checkbox “Categories 
of the attribute data are ordered.” Check this box if the data are ordinal and 
have more than two levels. Ordinal data means, for example, a 1 is in some 
sense “bigger” or “better” than a 0. For example, if we ask raters in a taste test 
a question like the following: “Rate the flavor as 0 (awful), 1 (OK), or 2 (deli- 
cious).” Our data are ordinal (acceptable is better than unacceptable), but 
there are only two levels, so we will not check this box. 


Stacked Inspector PartNum True 


Data are arranged as 

& Single column: 
Samples: arthur 
Appraisers: luspecter 


( Multiple columns 


Known standardfattribute: [True 


~ Categories of the attribute data are ordered 


Figure 10.16. Attribute gage R&R dialog box and data layout. 
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Within appraiser analysis 

Minitab evaluates the repeatability of appraisers by examining how often the 
appraiser “agrees with him/herself across trials.” It does this by looking at all 
of the classifications for each part and counting the number of parts where all 
classifications agreed. For our example each appraiser looked at two parts four 
times each. Minitab’s output, shown in Figure 10.17, indicates that InspA rated 
50% of the parts consistently, InspB 100%, and InspC 0%. The 95% confidence 
interval on the percentage agreement is also shown. The results are displayed 
graphically in Figure 10.18. 


Within Appraiser 


Assessment Agreement 


Appraiser #@ Inspected # Matched P 


InspA 
Insp 
InspCc 


® Matched: 


Figure 10.17. Minitab within appraiser assessment agreement. 
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Figure 10.18. Plot of within appraiser assessment agreement. 


358 MEASUREMENT SYSTEMS ANALYSIS 


Accuracy Analysis 


Minitab evaluates accuracy by looking at how often all of an appraiser’s clas- 
sifications for a given part agree with the standard. Figure 10.19 shows the 


results for our example. As before, Minitab combines the results for both days. 
The plot of these results is shown in Figure 10.20. 


Each Appraiser vs Standard 


Assessment Agreement 


Appraiser # Inspected # Matched 


InspA 
InspB 


Inepc 


Figure 10.19. Minitab appraiser vs standard agreement. 
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Figure 10.20. Plot of appraiser vs standard assessment agreement. 
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Minitab also looks at whether or not there is a distinct pattern in the disagree- 
ments with the standard. It does this by counting the number of times the 
appraiser classified an item as a 1 when the standard said it was a 0 (the # 1/0 
Percent column), how often the appraiser classified an item as a 0 when it was 
a 1 (the # 0/1 Percent column), and how often the appraiser’s classifications 
were mixed, i.e., is not repeatable (the #4 Mixed Percent column). The results 
are shown in Figure 10.21. The results indicate that there is no consistent bias, 
defined as consistently putting a unit into the same wrong category. The pro- 
blem, as was shown in the previous analysis, is that appraisers A and C are not 
repeatable. 


Assessment Disagree 


Appraiser 
InspA 
InepB 
Inspc 


Figure 10.21. Minitab appraiser assessment disagreement analysis. 


BETWEEN APPRAISER ASSESSMENTS 


Next, Minitab looks at all of the appraiser assessments for each part and 
counts how often every appraiser agrees on the classification of the part. The 
results, shown in Figure 10.22, indicate that this never happened during our 
experiment. The 95% confidence interval is also shown. 


Between Appraisers 


Assessment Agreement 


# Inspected #@ Matched f 


# Matched: All z 


Figure 10.22. Minitab between appraisers assessment agreement. 
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ALL APPRAISERS VS STANDARD 


Finally, Minitab looks at all of the appraiser assessments for each part and 
counts how often every appraiser agrees on the classification of the part 
and their classification agrees with the standard. This can’t be any better 
than the between appraiser assessment agreement shown in Figure 10.22. 
Unsurprisingly, the results, shown in Figure 10.23, indicate that this never 
happened during our experiment. The 95% confidence interval is also shown. 


All Apprais: 


n 


ers vs Standard 


Agr 


Figure 10.23. Minitab assessment vs standard agreement across all appraisers. 
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Knowledge Discovery 


KNOWLEDGE DISCOVERY TOOLS 


Getting the correct answer begins with asking the right question. The tools 
and techniques described in this section help the Six Sigma team learn which 
questions to ask. These simple tools are properly classified as data presentation 
tools, Many are graphically based, creating easy to understand pictures from 
the numbers and categories in the data. Others summarize the data, reducing 
incomprehensible data in massive tables to a few succinct numbers that convey 
essential information. 

In addition to these traditional tools of the trade, the reader should deter- 
mine if they have access to on-line analytic processing (OLAP) tools. OLAP is 
discussed briefly in Chapter 2. Contact your organization’s Information 
Systems department for additional information regarding OLAP. 

In this section, we will address the subject of time series analysis on a rela- 
tively simple level. First, we will look at statistical methods that can be used 
when we believe the data are from a stable process. This involves analysis of pat- 
terns in runs of data in a time-ordered sequence. We discuss the problem of auto- 
correlation in time series data and provide a method of dealing with this 
problem in Chapter 12, EWMA charts. 


Run charts 


Run charts are plots of data arranged in time sequence. Analysis of run charts 
is performed to determine if the patterns can be attributed to common causes 
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of variation, or if special causes of variation were present. Run charts should be 
used for preliminary analysis of any data measured on a continuous scale that 
can be organized in time sequence. Run chart candidates include such things as 
fuel consumption, production throughput, weight, size, etc. Run charts answer 
the question “was this process in statistical control for the time period 
observed?” If the answer is “no,” then the process was influenced by one or 
more special causes of variation. If the answer is “yes,” then the long-term per- 
formance of the process can be estimated using process capability analysis 
methods. The run chart tests shown are all non-parametric, i.e., there are no 
assumptions made regarding the underlying distribution. 


HOW TO PREPARE AND ANALYZE RUN CHARTS 


1. Plota line chart of the data in time sequence. 

2. Find the median of the data. This can be easily done by using the line 
chart you constructed in the above step. Simply place a straightedge or 
a piece of paper across the top of the chart, parallel to the bottom axis. 
Lower the straightedge until half of the data points appear above the 
straightedge, or on it. Draw a horizontal line across the chart at that 
point and label the line “Median” or X. This procedure is shown in 
Figure 11.1. 


Lower the straightedge 
until half of the values 
appear above it 


0 5 10 15 20 


Figure 11.1. Using a straightedge to find the median. 


Knowledge discovery tools 363 


As you might expect, run charts are evaluated by examining the “runs” on the 
chart. A “run” is a time-ordered sequence of points. There are several different 
statistical tests that can be applied to the runs. 


RUN LENGTH 


Arun to the median is a series of consecutive points on the same side of the 
median. Unless the process is being influenced by special causes, it is unlikely 
that a long series of consecutive points will all fall on the same side of the 
median. Thus, checking run length is one way of checking for special causes 
of variation. The length of a run is found by simply counting the number of 
consecutive points on the same side of the median. However, it may be that 
some values are exactly equal to the median. If only one value is exactly on 
the median line, ignore it. There will always be at least one value exactly on 
the median if you have an odd number of data points. If more than one 
value is on the line, assign them to one side or the other in a way that results 
in 50% being on one side and 50% on the other. On the run chart, mark 
those that will be counted as above the median with an a and those that will 
be counted below the median with a b. The run length concept is illustrated 
in Figure 11.2. 


A RUN OF 2 ABOVE 
THE MEDIAN 


\ A RUN OF 8 BELOW 


THE MEDIAN 


0 5 10 15 20 


Figure 11.2. Determination of run length. 
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After finding the longest run, compare the length of the longest run to the 
values in Table 11.1. If the longest run is longer than the maximum allowed, 
then the process was probably influenced by a special cause of variation 
(% = 0.05). With the example, there are 20 values plotted and the longest run 
was 8. Table 11.1 indicates that a run of 7 would not be too unusual for 20 plotted 
points but a run of 8 would be. Since our longest run is 8, we conclude that a 
special cause of variation is indicated and conduct an investigation to identify 
the special cause. 


NUMBER OF RUNS 


The number of runs we expect to find from a controlled process can also be 
mathematically determined. A process that is not being influenced by special 
causes will not have either too many runs or too few runs. The number of runs 
is found by simple counting. Referring to Figure 11.3, we see that there are 5 
runs. 

Table 11.2 is used to evaluate the number of runs. If you have fewer runs 
than the smallest allowed or more runs than the largest allowed then there is 
a high probability (% = 0.05) that a special cause is present. With the example, 
we have 20 values plotted and 5 runs. Table 11.2 indicates that for 20 plotted 
points, 6 to 15 runs are expected, so we conclude that a special cause was 
present. 


Table 11.1. Maximum run length. 


NUMBER OF PLOTTED VALUES MAXIMUM RUN LENGTH 


10 5 
15 6 
20 7 
30 8 
40 9 


50 10 
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0 5 10 iT) 20 


Figure 11.3. Determination of number of runs. 


TRENDS 


The run chart should not have any unusually long series of consecutive 
increases or decreases. If it does, then a trend is indicated and it is probably 
due to a special cause of variation (a=0.05). Compare the longest count of con- 
secutive increases or decreases to the longest allowed shown in Table 11.3, and 
if your count exceeds the table value then it is likely that a special cause of varia- 
tion caused the process to drift. 

Figure 11.4 shows the analysis of trends. Note that the trend can extend on 
both sides of the median, i.e., for this particular run test the median is ignored. 

When counting increases or decreases, ignore “no change” values. For 
example, the trend length in the series 2, 3, 3, 5, 6 is four. 


POINTERS FOR USING RUN CHARTS 


Run charts should not be used if too many of the numbers are the same. As a 
rule of thumb, don’t use run charts if more than 30% of the values are the same. 
For example, in the data set 1, 2, 3, 3, 6, 7, 7, 11, 17, 19, the number 3 appears 
twice and the number 7 appears twice. Thus, 4 of the 10, or 40% of the values 
are the same. 

Run charts are preliminary analysis tools, so if you have continuous data in 
time-order always sketch a quick run chart before doing any more complex 
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Table 11.2. Limits on the number of runs. 


Number of Plotted 
Values 


Smallest Run Count 


Largest Run Count 


10 


8 


12 


10 


11 


12 


13 


15 
16 


17 


18 


19 


20 


22 


23 


24 


25 


26 


27 


28 


30 


31 


32 
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Table 11.3. Maximum consecutive increases/decreases. 


MAXIMUM CONSECUTIVE 
INCREASES/DECREASES 


NUMBER OF PLOTTED VALUES 


9 to 20 


21 to 100 


101 or more 


analysis. Often the patterns on a run chart will point you in the right direction 
without any further work. 

Run charts are one of the least sensitive SPC techniques. They are unable to 
detect “freaks,” ie., single points dramatically different from the rest. Thus, 
run charts may fail to find a special cause even if a special cause was present. In 


10 [7 TREND OF7 ___» 
DECREASING 


TREND OF 5 
DECREASING 


ee ee ee Ss 


0 5 10 15 20 


Figure 11.4. Determination of trend length. 
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statistical parlance, run charts tend to have large Type I] errors, ie., they have a 
high probability of accepting the hypothesis of no special cause even when the 
special cause actually exists. Use run charts to aid in troubleshooting. The differ- 
ent run tests indicate different types of special causes. A long run on the same 
side of the median indicates a special cause that created a process shift. A long 
series of consecutively increasing or decreasing values indicates a special cause 
that created a trend. Too many runs often indicates a mixture of several sources 
of variation in the sample. Too few runs often occur in conjunction with a pro- 
cess shift or trend. If you have too few runs and they are not caused by a process 
shift or trend, then too few runs may indicate a mixture that follows a definite 
pattern (e.g., an operator who is periodically relieved). 


Descriptive statistics 


Typically, descriptive statistics are computed to describe properties of 
empirical distributions, that is, distributions of data from samples. There are 
three areas of interest: the distribution’s location or central tendency, its dis- 
persion, and its shape. The analyst may also want some idea of the magnitude 
of possible error in the statistical estimates. Table 11.4 describes some of the 
more common descriptive statistical measures. 


Table 11.4. Common descriptive statistics. 


SAMPLE STATISTIC DISCUSSION EQUATION/SYMBOL 


Measures of location 


Population mean The center of gravity or re 
=H DX 
i=1 


centroid of the distribution. 


where x is an observation, N is 
the population size. 


Sample mean The center of gravity or x- 1 ~ _ 
i=1 


centroid of a sample froma 


distribution. : : : 
where x is an observation, n is 


the sample size. 
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Median 


Mode 


The 50%/50% split point. 
Precisely half of the data set 
will be above the median, 


and half below it. 


The value that occurs most 
often. If the data are 
grouped, the mode is the 
group with the highest 
frequency. 


None 


Measures of dispersion 


the square of the units used 
for the original data. 


Range The distance between the R=Largest—Smallest 
sample extreme values. 
Population variance A measure of the variation N (xe; — py? 
: 2 1 
around the mean; units are on a 
i=1 


Population standard 
deviation 


A measure of the variation 
around the mean, in the 
same units as the original 
data. 


Sample variance 


A measure of the variation 

around the mean; units are 
the square of the units used 
for the original data. 


Sample standard deviation 


A measure of the variation 
around the mean, in the 
same units as the original 
data. 


Continued on next page ... 


370 


KNOWLEDGE DISCOVERY 


Table 11.4. (cont.) 


SAMPLE STATISTIC 


DISCUSSION EQUATION/SYMBOL 


Measures of shape 


Skewness 


A measure of asymmetry. 
Zero indicates perfect 
symmetry; the normal 


distribution has a skewness 


of zero. Positive skewness 
indicates that the “tail” of the 
distribution is more stretched 
on the side above the mean. 


Negative skewness indicates 
that the tail of the 
distribution is more stretched 
on the side below the mean. 


Kurtosis 


Kurtosis is a measure of flatness of the distribution. Heavier 
tailed distributions have larger kurtosis measures. The normal 
distribution has a kurtosis of 3. 


n n n 


4 3 2 
x; x; x; 


i= Y i= \2 i= v4 
st — 4X #1 _ 4+ 6x SE — 3x 
4 


B, 


S 


Figures 11.5—11.8 illustrate distributions with different descriptive statistics. 


Mean = Median = Mode 


Skewness = 0 


Median 
Mode 
Mean 


Skewness = +1 


Figure 11.5. Illustration of mean, median, and mode. 


Knowledge discovery tools 371 


Figure 11.6. Illustration of sigma. 


K=+1 K=0 K=-1 


Figure 11.7. Illustration of skewness. 


p2=4.5 Fanon 


i 4 Be = 1.0 


Figure 11.8. Illustration of kurtosis. 


Histograms 
A histogram is a pictorial representation of a set of data. It is created by 
grouping the measurements into “cells.” Histograms are used to determine the 
shape of a data set. Also, a histogram displays the numbers in a way that makes 
it easy to see the dispersion and central tendency and to compare the distrib- 
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ution to requirements. Histograms can be valuable troubleshooting aids. 
Comparisons between histograms from different machines, operators, vendors, 
etc., often reveal important differences. 


HOW TO CONSTRUCT A HISTOGRAM 


1. 
2. 


3. 


Find the largest and the smallest value in the data. 

Compute the range by subtracting the smallest value from the largest 
value. 

Select a number of cells for the histogram. Table 11.5 provides some use- 
ful guidelines. The final histogram may not have exactly the number of 
cells you choose here, as explained below. 


Table 11.5. Histogram cell determination guidelines. 


SAMPLE SIZE NUMBER OF CELLS 
100 or less 7 to 10 
101—200 11 to 15 
201 or more 13 to 20 


As an alternative, the number of cells can be found as the square root of 
the number in the sample. For example, if n=100, then the histogram 
would have 10 cells. Round to the nearest integer. 

Determine the width of each cell. We will use the letter W to stand for the 
cell width. W is computed from Equation 11.1. 


w= Range 
~ Number of Cells 


(11.1) 


The number W is a starting point. Round W to a convenient number. 
Rounding W will affect the number of cells in your histogram. 

Compute “cell boundaries.” A cell is a range of values and cell bound- 
aries define the start and end of each cell. Cell boundaries should have 
one more decimal place than the raw data values in the data set; for exam- 
ple, if the data are integers, the cell boundaries would have one decimal 
place. The low boundary of the first cell must be less than the smallest 
value in the data set. Other cell boundaries are found by adding W to 
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the previous boundary. Continue until the upper boundary is larger than 
the largest value in the data set. 

6. Go through the raw data and determine into which cell each value falls. 
Mark a tick in the appropriate cell. 

7. Count the ticks in each cell and record the count, also called the fre- 
quency, to the right of the tick marks. 

8. Construct a graph from the table. The vertical axis of the graph will show 
the frequency in each cell. The horizontal axis will show the cell bound- 
aries. Figure 11.9 illustrates the layout of a histogram. 


DESCRIPTIVE TITLE 
Largest frequency Largest relative % 
(or larger) (or larger) 


| | 


Frequency axis Relative % axis 


| (optional) 
Zero 
Low cell's low High cell’s high 
boundary boundary 
; Cell 
boundaries 


Figure 11.9. Layout of a histogram. 
From Pyzdek’s Guide to SPC—Volume One: Fundamentals, p. 61. 
Copyright © 1990 by Thomas Pyzdek. 


9. Draw bars representing the cell frequencies. The bars should all be the 
same width, the height of the bars should equal the frequency in the cell. 


HISTOGRAM EXAMPLE 


Assume you have the data in Table 11.6 on the size of a metal rod. The rods 
were sampled every hour for 20 consecutive hours and 5 consecutive rods were 
checked each time (20 subgroups of 5 values per group). 

1. Find the largest and the smallest value in the data set. The smallest value 

is 0.982 and the largest is 1.021. Both values are marked with an (*) in 
Table 11.6. 
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From Pyzdek’s Guide to SPC—Volume One: Fundamentals, p. 62. 


Table 11.6. Data for histogram. 


Copyright © 1990 by Thomas Pyzdek. 


ROW SAMPLE 1 SAMPLE 2 SAMPLE 3 SAMPLE 4 SAMPLE 5 
1 1.002 0.995 
2 1.000 0.997 
3 0.997 1.013 
4 0.990 1.008 
5 0.992 1.012 
6 1.000 1.002 
7 0.984 0.994 
8 0.987 0.994 
9 0.992 0.988 

10 0.994 0.990 
11 1.007 1.008 
12 0.995 0.989 
13 0.987 1.004 
14 0.991 1.001 
15 1.004 0.993 
16 1.004 1.010 
17 0.990 1.021* 
18 1.003 0.992 
19 1.000 0.985 
20 0.996 0.984 


Compute the range, R, by subtracting the smallest value from the largest 
value. R=1.021 — 0.982=0.039. 
Select a number of cells for the histogram. Since we have 100 values, 7 to 
10 cells are recommended. We will use 10 cells. 
Determine the width of each cell, W. Using Equation 11.1, we compute 
W=0.039/10=0.0039. We will round this to 0.004 for convenience. 
Thus, W=0.004. 
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Compute the cell boundaries. The low boundary of the first cell must be 
below our smallest value of 0.982, and our cell boundaries should have 
one decimal place more than our raw data. Thus, the lower cell boundary 
for the first cell will be 0.9815. Other cell boundaries are found by adding 
W=0.004 to the previous cell boundary until the upper boundary is 
greater than our largest value of 1.021. This gives us the cell boundaries 
in Table 11.7. 


Table 11.7. Histogram cell boundaries. 
From Pyzdek’s Guide to SPC—Volume One: Fundamentals, p. 63. 
Copyright © 1990 by Thomas Pyzdek. 


CELL NUMBER LOWER CELL BOUNDARY UPPER CELL BOUNDARY 
1 0.9815 0.9855 
2 0.9855 0.9895 
3 0.9895 0.9935 
4 0.9935 0.9975 
5 0.9975 1.0015 
6 1.0015 1.0055 
7 1.0055 1.0095 
8 1.0095 1.0135 
9 1.0135 1.0175 
10 1.0175 1.0215 


Go through the raw data and mark a tick in the appropriate cell for each 
data point. 

Count the tick marks in each cell and record the frequency to the right of 
each cell. The results of all we have done so far are shown in Table 11.8. 
Table 11.8 is often referred to as a “frequency table” or “frequency tally 
sheet.” 
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Table 11.8. Frequency tally sheet. 
From Pyzdek’s Guide to SPC—Volume One: Fundamentals, p. 64. 


Copyright © 1990 by Thomas Pyzdek. 


CELL CELL CELL 
NUMBER START END TALLY FREQUENCY 
1 0.9815 8 
2 0.9855 9 
3 0.9895 ANRNENII 17 
4 0.9935 ANNI! 16 
5 0.9975 PNIIT 9 
6 1.0015 PNT AWNITTI 19 
7 1.0055 11 
8 1.0095 6 
9 1.0135 3 
10 1.0175 1.0215 I| 2 


Construct a graph from the table in step 7. The frequency column will be 
plotted on the vertical axis, and the cell boundaries will be shown on the hor- 


izontal (bottom) axis. The resulting histogram is shown in Figure 11.10. 


HOW TO CONSTRUCT HISTOGRAMS USING 


MINITAB 


Minitab’s histogram function expects to have the data ina single column. If your 
data are not arranged this way, you can use Minitab’s Manip-Stack Columns 
function to put multiple columns into a single column. Once the data are in 
the proper format, use Minitab’s Graph-Histogram function (Figure 11.11) to 


create the histogram (Figure 11.12). 
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CELL BOUNDARY 


Figure 11.10. Completed histogram. 
From Pyzdek’s Guide to SPC—Volume One: Fundamentals, p. 61. 
Copyright © 1990 by Thomas Pyzdek. 
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Figure 11.11. Minitab’s histogram dialog box. 
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Frequency 


T T T T T T T T 
0.980 0.986 0.992 0.998 1.004 1.010 1.016 1.022 
StackedData 


Figure 11.12. Histogram. 


It is often helpful to see a distribution curve superimposed over the histo- 
gram. Minitab has the ability to put a wide variety of distribution curves on 
histograms, although the procedure is tedious. It will be illustrated here for the 
normal distribution. Minitab’s help facility also describes the procedure 


shown below. 


1. Sort the data using Manip > Sort. Store the sorted data in a different 
column than the one containing the original data. 

2. Determine the mean and sigma value using Stat > Basic Statistics > 
Store Descriptive Statistics. For our data: 


cs | c9 
Meant StDevi1 
0.99832 0.0088773 


ad 


3. Get the probability distribution using Calc > Probability Distributions 
> Normal. Enter the mean and standard deviation. Store the results in 
a separate column (e.g., NormProbData). 
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5 =e (RR <5 WS a FE a PE 
‘SAMPLE2 SAMPLE3 SAMPLE4 SAMPLES StackedData NormProbData_ Meant StDev1 
1 0.995 1.000 1.002 1.005 0.982 3.7736 0.99832 0.0088773 
2 0.997 1.007 0.992 0.995 0 984 5.6236 
EBB scrnsstrbuton x! 
4 
SAMPLE 1 © Probability density 
7)  ic2 SAMPLE 2 
6 c3 SAMPLE3 © Cumulative probability 
; je4 SAMPLE 4 
7) ‘les SAMPLES © Inverse cumulative probability 
8 C6 StackedData 
ry ; C7 NormProbDat 
ce Mean 1 , — 
40| |c9 StDev1 Mean: |.99932 
11 Standard deviation: [.0088773 
12, 
13 
14 © Input column: [SteckedDate 
15 


Optional storage: formProbDatal 


. 
n 


4. Adjust the NormProbData values in accordance with your histogram 
cell interval. In the previous example we let Minitab choose the cell inter- 
val for use. Here we will use a cell interval of 0.005. Choose Cale > 
Calculator and enter the information as shown below: 


SAMPLE 1 Store result in variable: | ‘NormProbData ' 
SAMPLE2 


SAMPLE3 Expression: 


SAMPLE4 
SAMPLES 'NormProbData'| * COUNT('StackedData')#0.005 


StackedData 


Meanl 
StDevl 


5. Create the histogram with the normal curve: 
Choose Graph > Histogram 


For X, select StackedData 
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Frequency 


Click Options. Under Type of Intervals, choose CutPoint. Under 
Definition of Intervals, choose Midpoint/Cutpoint positions and 
type 0.98:1.02/0.005. Click OK. 


Choose Annotation > Line. In Points, choose Use Variables and 
select StackedData NormProbData. Click OK. 


The completed histogram is shown in Figure 11.13. 


N 
oO 


= 
oO 


— 


T 
0.980 


T T T T T T T T 
0.985 0.990 0.995 1.000 1.005 1.010 1.015 1.020 
StackedData 


Figure 11.13. Histogram with normal curve superimposed. 


POINTERS FOR USING HISTOGRAMS 


Histograms can be used to compare a process to requirements if you draw 
the specification lines on the histogram. If you do this, be sure to scale 
the histogram accordingly. 

Histograms should not be used alone. Always construct a run chart or a 
control chart before constructing a histogram. They are needed because 
histograms will often conceal out of control conditions due to the fact 
that they don’t show the time sequence of the data. 

Evaluate the pattern of the histogram to determine if you can detect 
changes of any kind. The changes will usually be indicated by multiple 
modes or “peaks” on the histogram. Most real-world processes produce 
histograms with a single peak. However, histograms from small samples 
often have multiple peaks that merely represent sampling variation. Also, 
multiple peaks are sometimes caused by an unfortunate choice of the 
number of cells. Also, processes heavily influenced by behavior patterns 
are often multi-modal. For example, traffic patterns have distinct “rush- 
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hours,” and prime time is prime time precisely because more people tend 
to watch television at that time. 

¢ Compare histograms from different periods of time. Changes in histo- 
gram patterns from one time period to the next can be very useful in find- 
ing ways to improve the process. 

e Stratify the data by plotting separate histograms for different sources of 
data. For example, with the rod diameter histogram we might want to 
plot separate histograms for shafts made from different vendors’ materials 
or made by different operators or machines. This can sometimes reveal 
things that even control charts don’t detect. 


Exploratory data analysis 


Data analysis can be divided into two broad phases: an exploratory phase and 
a confirmatory phase. Data analysis can be thought of as detective work. 
Before the “trial” one must collect evidence and examine it thoroughly. One 
must have a basis for developing a theory of cause and effect. Is there a gap in 
the data? Are there patterns that suggest some mechanism? Or, are there pat- 
terns that are simply mysterious (e.g., are all of the numbers even or odd)? Do 
outliers occur? Are there patterns in the variation of the data? What are the 
shapes of the distributions? This activity is known as exploratory data analysis 
(EDA). Tukey’s 1977 book with this title elevated this task to acceptability 
among “serious” devotees of statistics. 

Four themes appear repeatedly throughout EDA: resistance, residuals, re- 
expression, and visual display. Resistance refers to the insensitivity of a method 
to a small change in the data. If a small amount of the data is contaminated, the 
method shouldn’t produce dramatically different results. Residuals are what 
remain after removing the effect of a model or a summary. For example, one 
might subtract the mean from each value, or look at deviations about a regres- 
sion line. Re-expression involves examination of different scales on which the 
data are displayed. Tukey focused most of his attention on simple power trans- 
formations such as y = ./x,y = x°, y = 1/x . Visual display helps the analyst 
examine the data graphically to grasp regularities and peculiarities in the data. 

EDA is based on a simple basic premise: it is important to understand what 
you can do before you learn to measure how well you seem to have done it 
(Tukey, 1977). The objective is to investigate the appearance of the data, not to 
confirm some prior hypothesis. While there are a large number of EDA meth- 
ods and techniques, there are two which are commonly encountered in Six 
Sigma work: stem-and-leaf plots and boxplots. These techniques are commonly 
included in most statistics packages. (SPSS was used to create the figures used 


382 KNOWLEDGE DISCOVERY 


in this book.) However, the graphics of EDA are simple enough to be done 
easily by hand. 


STEM-AND-LEAF PLOTS 


Stem-and-leaf plots are a variation of histograms and are especially useful for 
smaller data sets (n<200). A major advantage of stem-and-leaf plots over the 
histogram is that the raw data values are preserved, sometimes completely and 
sometimes only partially. There is a loss of information in the histogram 
because the histogram reduces the data by grouping several values into a single 
cell. 

Figure 11.14 is a stem-and-leaf plot of diastolic blood pressures. As in a his- 
togram, the length of each row corresponds to the number of cases that fall 
into a particular interval. However, a stem-and-leaf plot represents each case 
with a numeric value that corresponds to the actual observed value. This is 
done by dividing observed values into two components—the leading digit or 
digits, called the stem, and the trailing digit, called the /eaf. For example, the 
value 75 has a stem of 7 and a leaf of 5. 


FREQUENCY STEM & LEAF 


.00 6 * 
7.00 6 . 5558889 
13.00 7 * 0000111223344 
32.00 7 . 55555555667777777777788888889999 
44.00 8 * 00000000000000000000001111122222333333334444 
45.00 8 . 555555555566666667777777777777788888999999999 
31.00 9 * 0000000001111111122222222333334 
27.00 9 . 556666677777788888888899999 
13.00 10 * 0000122233333 
11.00 10 . 55555577899 
5.00 11 * 00003 
5.00 11 . 55789 
2.00 12 * O12 
4.00 Extremes (125), (133), (160) 
Stem width: 10 
Each leaf: 1 case (s) 


Figure 11.14. Stem-and-leaf plot of diastolic blood pressures. 
From SPSS for Windows Base System User’s Guide, p. 183. Copyright © 1993. Used by 
permission of the publisher, SPSS, Inc., Chicago, IL. 
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In this example, each stem is divided into two rows. The first row of each pair 
has cases with leaves of 0 through 4, while the second row has cases with leaves 
of 5 through 9. Consider the two rows that correspond to the stem of 11. In the 
first row, we can see that there are four cases with diastolic blood pressure of 
110 and one case with a reading of 113. In the second row, there are two cases 
with a value of 115 and one case each with a value of 117, 118, and 119. 

The last row of the stem-and-leaf plot is for cases with extreme values (values 
far removed from the rest). In this row, the actual values are displayed in 
parentheses. In the frequency column, we see that there are four extreme cases. 
Their values are 125, 133, and 160. Only distinct values are listed. 

When there are few stems, it is sometimes useful to subdivide each stem even 
further. Consider Figure 11.15 a stem-and-leaf plot of cholesterol levels. In this 
figure, stems 2 and 3 are divided into five parts, each representing two leaf 
values. The first row, designated by an asterisk, is for leaves of 0 and 1; the 
next, designated by t, is for leaves of 2’s and 3’s; the third, designated by f, is for 
leaves of 4’s and 5’s; the fourth, designated by s, is for leaves of 6’s and 7’s; and 
the fifth, designated by a period, is for leaves of 8’s and 9’s. Rows without cases 
are not represented in the plot. For example, in Figure 11.15, the first two rows 
for stem 1 (corresponding to 0-1 and 2-3) are omitted. 


FREQUENCY STEM & LEAF 
1.00 Extremes (106) 
2.00 1 f 55 
6.00 1 os 677777 
12.00 1. 888889999999 
23.00 2 * 00000000000001111111111 
36.00 2 t 222222222222222223333333333333333333 
35.00 2 f 44444444444444444455555555555555555 
42.00 2 s 666666666666666666666777777777777777777777 
28.00 2 . 8888888888888889999999999999 
18.00 3 * 000000011111111111 
17.00 3) t 22222222222233333 
9.00 3 f 444445555 
6.00 3. s 666777 
1.00 3... «8 
3.00 Extremes (393), (425), (515) 
Stem width: 100 
Each leaf: 1 case (s) 


Figure 11.15. Stem-and-leaf plot of cholesterol levels. 


From SPSS for Windows Base System User’s Guide, p. 185. Copyright © 1993. Used by 


permission of the publisher, SPSS, Inc., Chicago, IL. 
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This stem-and-leaf plot differs from the previous one in another way. Since 
cholesterol values have a wide range—from 106 to 515 in this example—using 
the first two digits for the stem would result in an unnecessarily detailed plot. 
Therefore, we will use only the hundreds digit as the stem, rather than the first 
two digits. The stem setting of 100 appears in the row labeled Stem width. The 
leaf is then the tens digit. The last digit is ignored. Thus, from this particular 
stem-and-leaf plot, it is not possible to determine the exact cholesterol level for 
a case. Instead, each is classified by only its first two digits. 


BOXPLOTS 


A display that further summarizes information about the distribution of the 
values is the boxplot. Instead of plotting the actual values, a boxplot displays 
summary statistics for the distribution. It is a plot of the 25th, 50th, and 75th per- 
centiles, as well as values far removed from the rest. 

Figure 11.16 shows an annotated sketch of a boxplot. The lower boundary of 
the box is the 25th percentile. Tukey refers to the 25th and 75th percentile 
“hinges.” Note that the 50th percentile is the median of the overall data set, 
the 25th percentile is the median of those values below the median, and the 
75th percentile is the median of those values above the median. The horizontal 
line inside the box represents the median. 50% of the cases are included within 
the box. The box length corresponds to the interquartile range, which is the dif- 
ference between the 25th and 75th percentiles. 

The boxplot includes two categories of cases with outlying values. Cases with 
values that are more than 3 box-lengths from the upper or lower edge of the 
box are called extreme values. On the boxplot, these are designated with an 
asterisk (*). Cases with values that are between 1.5 and 3 box-lengths from the 
upper or lower edge of the box are called outliers and are designated with a circle. 
The largest and smallest observed values that aren’t outliers are also shown. 
Lines are drawn from the ends of the box to these values. (These lines are some- 
times called whiskers and the plot is then called a box-and-whiskers plot.) 

Despite its simplicity, the boxplot contains an impressive amount of infor- 
mation. From the median you can determine the central tendency, or location. 
From the length of the box, you can determine the spread, or variability, of 
your observations. If the median is not in the center of the box, you know that 
the observed values are skewed. If the median is closer to the bottom of the box 
than to the top, the data are positively skewed. If the median is closer to the 
top of the box than to the bottom, the opposite is true: the distribution is nega- 
tively skewed. The length of the tail is shown by the whiskers and the outlying 
and extreme points. 
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* Values more than 3 box-lengths 
above the 75th percentile (extremes) 


C) Values more than 1.5 box-lengths 
above the 75th percentile (outliers) 


Largest observed value that isn’t an outlier 


75th percentile 


Median (50th percentile) 


25th percentile 


Smallest observed value that isn’t an outlier 


C) Values more than 1.5 box-lengths 
below the 25th percentile (outliers) 


* Values more than 3 box-lengths 
below the 25th percentile (extremes) 


Figure 11.16. Annotated boxplot. 


Boxplots are particularly useful for comparing the distribution of values in 
several groups. Figure 11.17 shows boxplots for the salaries for several different 
job titles. 

The boxplot makes it easy to see the different properties of the distributions. 
The location, variability, and shapes of the distributions are obvious at a glance. 
This ease of interpretation is something that statistics alone cannot provide. 


ESTABLISHING THE PROCESS BASELINE 


The process baseline is best described as “what were things like before the 
P 8 

. ” . . . . . 
project?” There are several reasons for obtaining this information: 
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Office trainee College trainee MBA trainee 


Employment category 


Figure 11.17. Boxplots of salary by job category. 


To determine if the project should be pursued. Although the project charter 
provides a business case for the project, it sometimes happens that addi- 
tional, detailed information fails to support it. It may be that the situation 
isn’t as bad as people think, or the project may be addressing an unimpor- 
tant aspect of the problem. 

To orient the project team. The process baseline helps the team identify 
CTQs and other hard metrics. The information on the historic perfor- 
mance of these metrics may point the team to strategies. For example, if 
the process is erratic and unstable the team would pursue a different 
strategy than if it was operating at a consistently poor level. 

To provide data that will be used to estimate savings. Baseline information 
will be invaluable when the project is over and the team is trying to deter- 
mine the magnitude of the savings or improvement. Many a Black Belt 
has discovered after the fact that the information they need is no longer 
available after the completion of the project, making it impossible to 
determine what benefit was obtained. For example, a project that stream- 
lined a production control system was aimed at improving morale by 
reducing unpaid overtime worked by exempt employees. However, no 
measure of employee morale was obtained ahead of time. Nor was the 
unpaid overtime documented anywhere. Consequently, the Black Belt 
wasn't able to substantiate his claims of improvement and his certification 
(and pay increase) was postponed. 
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Describing the Process Baseline 
QUALITATIVE DESCRIPTIONS 


The process baseline should be described in both qualitative and quantitative 
terms. It’s not enough to report survey results or complaint counts, the voice 
of the customer (VOC) should be made heard. If your customers are saying 
that your service stinks, then don’t mince words, tell it like the customer tells 
it.* Likewise, include glowing praise. The new process might make the average 
performance better and improve consistency, but if it creates ho-hum satisfac- 
tion at the expense of eliminating delight, that fact should be known. It may be 
that the new system takes the joy out of customer service work, which will 
have adverse consequences on employee morale and might lead to unexpected 
consequences that need to be considered. 

Inaddition tothe VOC, youmayalsowanttocapture thevoice of the employee 
(VOE). Do employees say they feel great about what they do? Or do they dread 
coming in each day? Is it a great place to work? Why or why not? Are employees 
eager to transfer to other jobs just to get away from the stress? What do employees 
think would make things better? If you find a workplace that is a delight to the 
employees, you might want to think twice about changing it. If the workplace isa 
chamber of horrors, you may want to speed up the pace of the project. 

A descriptive narrative by the team members should be considered. Every 
team member should spend time in the work area. There is no substitute for 
firsthand observation. It need not be a formal audit. Just go and look at the 
way things are done. Talk to people doing the work and actively listen to what 
they have to say. Watch what they do. Look for differences between the way dif- 
ferent people do similar tasks. Document your observations and share them 
with the team and the sponsor. 

Collect information contained in memos, email, reports, studies, etc. 
Organize the information using affinity analysis and other methods of categoriz- 
ing. Arrange it in time-order and look for patterns. Were things once better than 
they are now? Are things getting worse? What might account for these trends? 


QUANTITATIVE DESCRIPTION 


Quantifying the process baseline involves answering some simple questions: 
What are the key metrics for this process? (Critical to quality, cost, 
schedule, customer satisfaction, etc.) 

© What are the operational definitions of these metrics? 


*Profanity and obscenity excepted, of course. 
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© Are these the metrics that will be used after completing the project to 
measure success? 

What data are available for these metrics? 

O If none, how will data be obtained? 

© What is the quality of the data? 

Once the metrics are identified and the data located and validated, perform 

analyses to answer these questions: 
When historical data are looked at over a period of time, are there any pat- 
terns or trends? What might be causing this? (Run charts, time series 
charts, process behavior charts (control charts)) 
Were things ever better than they are now? Why? 
Should the data be transformed to make them easier to analyze? 
What is the historical central tendency? (Mean, median and mode) 
Whatis the historical variability? (Inter-quartile range, standard deviation) 
What is the historical shape or distribution? (Histograms, stem-and-leaf 
plots, box plots, dot plots) 
Are there any interesting relationships between variables? Cross tabula- 
tions should be created to evaluate possible relationships with categorical 
data. Scatterplots and correlation studies can be used to study continuous 
data. 


The analyses can be performed by any team member, with the guidance of a 
Black Belt. The results should be shared with the team. Brief summaries of espe- 
cially important findings should be reported to the process owner and sponsor. 
If the results indicate a need to change the project charter, the sponsor should 
be informed. 


SIPOC 


Virtually all Six Sigma projects address business processes that have an 
impact on a top-level enterprise strategy. In previous chapters a great deal of 
attention was devoted to developing a list of project candidates by meticulously 
linking projects and strategies using dashboards, QFD, structured decision 
making, business process mapping, and many other tools and techniques. 
However, Six Sigma teams usually find that although this approach succeeds 
in identifying important projects, these projects tend to have too large a scope 
to be completed within the time and budget constraints. More work is needed 
to clearly define that portion of the overall business process to be improved by 
the project. One way to do this is to apply process flowcharting or mapping to 
subprocesses until reaching the part of the process that has been assigned to 
the team for improvement. A series of questions are asked, such as: 
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For which stakeholder does this process primarily exist? 
What value does it create? What output is produced? 
Who is the owner of this process? 
Who provides inputs to this process? 
What are the inputs? 
What resources does this process use? 
What steps create the value? 
Are there subprocesses with natural start and end points? 
These questions, which are common to nearly all processes addressed by Six 
Sigma projects, have been arranged into a standard format known as SIPOC. 
SIPOC stands for Suppliers-Inputs-Process-Outputs-Customers. 


SNAMRWNS 


Process for creating a SIPOC diagram 


SIPOCs begin with people who know something about the process. This may 
involve people who are not full-time members of the Six Sigma team. Bring the 
people together in a room and conduct a “focused brainstorming” session. To 
begin, briefly describe the process and obtain consensus on the definition. For 
example: 

“Make it easy for the customer to reach technical support by phone” 
“Reduce the space needed to store tooling” 

“Reduce the downtime on the Niad CNC machine” 

“Get roofing crew to the work site on time” 

“Reduce extra trips taken by copier maintenance person” 


Post flipcharts labeled suppliers, inputs, process, outputs, customers. Once 
the process has been described, create the SIPOC diagram as follows: 


1. Create a simple, high-level process map of the process. Display this con- 
spicuously while the remaining steps are taken to provide a reminder to 
the team. 


Perform the steps below using brainstorming rules. Write down all ideas with- 
out critiquing them. 


2. Identify the outputs of this process. Record on the Outputs flip chart. 

3. Identify the customers who will receive the outputs. Record on the 
Customers flip chart. 

4. Identify the inputs needed for the process to create the outputs. Record 
on the Inputs flip chart. 

5. Identify the suppliers of the inputs. Record on the Suppliers flip chart. 

Clean up the lists by analyzing, rephrasing, combining, moving, etc. 

7. Create a SIPOC diagram. 


—- 
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Product 


Customer looks fe 
number in manua 


Figure 11.18. Process map for contacting technical support by telephone. 


8. Review the SIPOC with the project sponsor and process owner. Modify 
as necessary. 


SIPOC example 


A software company wants to improve overall customer satisfaction (Big Y). 
Research has indicated that a key component of overall satisfaction is satisfac- 
tion with technical support (Little Y). Additional drill down of customer com- 
ments indicates that one important driver of technical support satisfaction is 
the customer’s perception that it is easy to contact technical support. There 
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are several different types of technical support available, such as self-help built 
into the product, the web, or the phone. The process owner commissioned Six 
Sigma projects for each type of contact. This team’s charter is telephone sup- 
port. 

To begin, the team created the process map shown in Figure 11.18. 

Next the team determined that there were different billing options and 
created a work breakdown structure with each billing option being treated as a 
subproject. For this example we will follow the subproject relating to the 
billing-by-the-minute (BBTM) option. After completing the process described 
above, the team produced the SIPOC shown in Figure 11.19. 

Note that the process is mapped at a very low level. At this level the process 
map is usually linear, with no decision boxes shown. The typical SIPOC shows 
the process as it is supposed to behave. Optionally, the SIPOC can show the 
unintended or undesirable outcomes, as shown in Figure 11.20. 


Easy to Contact BBTM 


PROCESS 
SUPPLIERS INPUTS OUTPUTS CUSTOMERS 
* Phone company * Question, or issue Gia i * Customer finds ° User 
* Product * Manual anciuness number * Technician 
to find number 
* Internal computer * Phone directory 
systems * Web 
+ Internal phone v + System gets caller 
systems * Dial phone correctly Customer calls ID 
call center * VRU gets call 
* Customer makes Vv 
VRU selections Enter VRU * VRU routes call to 
CSA 
*CSA ¥ + Listen to customer 
sees customer CSA answers ey dees 
info on screen call * Collect routing info 
* Customer presents * Decide where to 
question or issue send call 
Vv 
* Customer gives CC CSA obtains * CSA gives info on 
ere credit card support options 
inf tion. 
* Customer purchases ik Upeell. * CSA takes order 
premium support : 
* Customer opts for 
BBTM 
CSA transfers * Call goes to 
* CSA selects transfer call to technician 
option technician * Call goes to queue 


Figure 11.19. SIPOC for easy to contact BBTM. 
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SUPPLIERS 
* Phone company 
* Product 
* Internal computer 
systems 
+ Internal phone 
systems 


NOT Easy to Contact BBTM 
PROCESS 
INPUTS OUTPUTS CUSTOMERS 
* Customer doesn’t , * Customer can’t find * User 
know where to look Customer tries number * Technician 
for aiumber to find number a eastamer bets 
* Number in manual is “wrong number’ 
incorrect message 
v 
+ Dial phone Customer calls * No caller ID 
incorrectly call center * VRU drops call 
* Customer makes = 
Enter VRU . VRU routes call 
wrong VRU incorrectly 
eleruons * VRU loses call 
Vv 
* CSA sees a CSA answers + Wrong person 
customer info call answers call 
* Customer presents * Call queued 
incorrect question or 
issue ¥ 
CSA obtains « Customer annoyed 
a aah credit card by upsell 
+ Customer won’t give : : 
‘ information. 
CC info 
Upsell. 
* Customer won’t 
listen to upsell 
* Call goes to wrong 
CSA selects wrong CSA transfers person 
transfer option call to * Call is lost 
+ Phone system error technician * Call goes to queue 


Figure 11.20. SIPOC for undesirable outcomes. 


This “bad process” SIPOC is used only for team troubleshooting. It helps the 
team formulate hypotheses to be tested during the analyze phase. 

SIPOC analyses focus on the Xs that drive the Ys. It helps the team under- 
stand which “dials to turn” to make the top-level dashboard’s Big Y move. In 
the example, let’s assume that the team collects information and determines 
that a significant percentage of the customers can’t find the phone number for 
technical support. A root cause of the problem then, is the obscure location of 
the support center phone number. Improving overall customer satisfaction is 
linked to making it easier for the customer to locate the correct number, per- 
haps by placing a big, conspicuous sticker with the phone number on the cover 
of the manual. The Big Y and the root cause X are separated by several levels, 
but the process mapping and SIPOC analysis chain provides a methodology 
for making the connection. 
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Statistical Process Control 
Techniques 


STATISTICAL PROCESS CONTROL (SPC) 
Types of control charts 


There are two broad categories of control charts: those for use with contin- 
uous data (e.g, measurements) and those for use with attributes data (eg. 
counts). This section describes the various charts used for these different data. 


VARIABLE CHARTS 


In statistical process control (SPC), the mean, range, and standard deviation 
are the statistics most often used for analyzing measurement data. Control 
charts are used to monitor these statistics. An out-of-control point for any of 
these statistics is an indication that a special cause of variation is present and 
that an immediate investigation should be made to identify the special cause. 


Averages and ranges control charts 

Averages charts are statistical tools used to evaluate the central tendency of a 
process over time. Ranges charts are statistical tools used to evaluate the dis- 
persion or spread of a process over time. 


Copyright 2003 by The McGraw-Hill Companies, Inc. Click Here for Terms of Use. 
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Averages charts answer the question: “Has a special cause of variation caused 
the central tendency of this process to change over the time period observed?” 
Ranges charts answer the question: “Has a special cause of variation caused the 
process distribution to become more or less consistent?” Averages and ranges 
charts can be applied to any continuous variable such as weight, size, etc. 

The basis of the control chart is therational subgroup. Rational subgroups (see 
page 420) are composed of items which were produced under essentially the 
same conditions. The average and range are computed for each subgroup sepa- 
rately, then plotted on the control chart. Each subgroup’s statistics are compared 
to the control limits, and patterns of variation between subgroups are analyzed. 


Subgroup equations for averages and ranges charts 


2 f subgroup measurements 
rae sum of subgroup u (12.1) 


subgroup size 


R = Largest in subgroup — Smallest in subgroup (12.2) 


Control limit equations for averages and ranges charts 

Control limits for both the averages and the ranges charts are computed such 
that it is highly unlikely that a subgroup average or range from a stable process 
would fall outside of the limits. All control limits are set at plus and minus 
three standard deviations from the center line of the chart. Thus, the control 
limits for subgroup averages are plus and minus three standard deviations of 
the mean from the grand average; the control limits for the subgroup ranges 
are plus and minus three standard deviations of the range from the average 
range. These control limits are quite robust with respect to non-normality in 
the process distribution. 

To facilitate calculations, constants are used in the control limit equations. 
Table 11 in the Appendix provides control chart constants for subgroups of 25 
or less. The derivation of the various control chart constants is shown in Burr 
(1976, pp. 97-105). 


Control limit equations for ranges charts 


sum of subgroup ranges 


R= 12.3 
number of subgroups ee) 
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LCL =D,R (12.4) 


UCL = D,R (12.5) 


Control limit equations for averages charts using R-bar 


sum of subgroup averages 


X= 12.6 
number of subgroups “eo 
LCL =X—A,R (12.7) 
UCL =X+A,R (12.8) 


Example of averages and ranges control charts 
Table 12.1 contains 25 subgroups of five observations each. 
The control limits are calculated from these data as follows: 


Ranges control chart example 


- sum of subgroup ranges 369 
R= = = 14.76 
number of subgroups 25 


LCLp =D;R = 0 x 14.76 =0 


UCLp = D,R = 2.115 x 14.76 = 31.22 


Since it is not possible to have a subgroup range less than zero, the LCL is not 
shown on the control chart for ranges. 


Averages control chart example 


= sum of subgroup averages 2,487.5 
x= = = 99.5 
number of subgroups 25 
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Table 12.1. Data for averages and ranges control charts. 


Sample 1 | Sample 2 | Sample 3 | Sample 4 | Sample 5 | AVERAGE | RANGE 
110 93 99 98 
103 95 109 95 

97 110 90 97 
96 102 105 90 
105 110 109 93 
110 91 104 91 
100 96 104 93 
93 90 110 109 
90 105 109 90 
103 93 93 99 
97 97 104 103 
103 100 91 103 
90 101 96 104 
97 106 97 105 
99 94 %6 98 
106 93 104 93 
90 95 98 109 
96 96 108 97 
109 %6 91 98 
90 95 94 107 
91 101 96 96 
108 97 101 103 
96 97 106 96 
101 107 104 109 
96 91 %6 91 105 95.8 14 
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LCLy =X —A,R = 99.5 — 0.577 x 14.76 = 90.97 
UCL; =X +A,R = 99.5 + 0.577 x 14.76 = 108.00 


The completed averages and ranges control charts are shown in Figure 12.1. 


AVERAGES CONTROL CHART 
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Figure 12.1. Completed averages and ranges control charts. 
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The above charts show a process in statistical control. This merely means that 
we can predict the limits of variability for this process. To determine the capabil- 
ity of the process with respect to requirements one must use the methods 
described in Chapter 13, Process Capability Analysis. 


Averages and standard deviation (sigma) control charts 

Averages and standard deviation control charts are conceptually identical to 
averages and ranges control charts. The difference is that the subgroup standard 
deviation is used to measure dispersion rather than the subgroup range. The 
subgroup standard deviation is statistically more efficient than the subgroup 
range for subgroup sizes greater than 2. This efficiency advantage increases as 
the subgroup size increases. However, the range is easier to compute and easier 
for most people to understand. In general, this author recommends using sub- 
group ranges unless the subgroup size is 10 or larger. However, if the analyses 
are to be interpreted by statistically knowledgeable personnel and calculations 
are not a problem, the standard deviation chart may be preferred for all sub- 
group sizes. 


Subgroup equations for averages and sigma charts 


sum of subgroup measurements 


X= (12.9) 


subgroup size 


(12.10) 


The standard deviation, s, is computed separately for each subgroup, using 
the subgroup average rather than the grand average. This is an important 
point; using the grand average would introduce special cause variation if the 
process were out of control, thereby underestimating the process capability, 
perhaps significantly. 


Control limit equations for averages and sigma charts 

Control limits for both the averages and the sigma charts are computed such 
that it is highly unlikely that a subgroup average or sigma from a stable process 
would fall outside of the limits. All control limits are set at plus and minus 
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three standard deviations from the center line of the chart. Thus, the control 
limits for subgroup averages are plus and minus three standard deviations of 
the mean from the grand average. The control limits for the subgroup sigmas 
are plus and minus three standard deviations of sigma from the average sigma. 
These control limits are quite robust with respect to non-normality in the pro- 
cess distribution. 

To facilitate calculations, constants are used in the control limit equations. 
Table 11 in the Appendix provides control chart constants for subgroups of 25 
or less. 


Control limit equations for sigma charts based on S-bar 


sum of subgroup sigmas 


$= 12.11 
: number of subgroups ( ) 


Control limit equations for averages charts based on S-bar 


sum of subgroup averages 


x — 12.14 
number of subgroups ( ) 
jie) eee ee (12.15) 
UCL=X+A,5 (12.16) 


Example of averages and standard deviation control charts 

To illustrate the calculations and to compare the range method to the stan- 
dard deviation results, the data used in the previous example will be reanalyzed 
using the subgroup standard deviation rather than the subgroup range (Table 
12.2). 
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Table 12.2. Data for averages and sigma control charts. 


Sample1 | Sample2 | Sample3 | Sample 4 | Sample5 | AVERAGE | SIGMA 
110 93 99 98 109 101.8 7.396 
103 95 109 95 98 100.0 6.000 

97 110 90 97 100 98.8 7.259 
%6 102 105 90 96 97.8 5.848 
105 110 109 93 98 103.0 7.314 
110 91 104 91 101 99.4 8.325 
100 %6 104 93 96 97.8 4.266 
93 90 110 109 105 101.4 9.290 
90 105 109 90 108 100.4 9.607 
103 93 93 99 96 96.8 4.266 
97 97 104 103 92 98.6 4.930 
103 100 91 103 105 100.4 5.550 
90 101 96 104 108 99.8 7.014 
97 106 97 105 96 100.2 4.868 
99 94 96 98 90 95.4 3.578 
106 93 104 93 99 99.0 6.042 
90 95 98 109 110 100.4 8.792 
96 96 108 97 103 100.0 5.339 
109 96 91 98 109 100.6 8.081 
90 95 94 107 99 97.0 6.442 
91 101 %6 %6 109 98.6 6.804 
108 97 101 103 94 100.6 5.413 
96 97 106 96 98 98.6 4.219 
101 107 104 109 104 105.0 3.082 
%6 91 96 91 105 95.8 5.718 
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The control limits are calculated from this data as follows: 


Sigma control chart 


__ sum of subgroup sigmas — 155.45 _ pane 
number of subgroups 250 


LCL, = Bys =0 x 6.218 =0 


UCL, = B,s = 2.089 x 6.218 = 12.989 


Since it is not possible to have a subgroup sigma less than zero, the LCL is not 
shown on the control chart for sigma for this example. 


Averages control chart 


sum of subgroup averages 2,487.5 


x = = 99.5 


number of subgroups 25 
LCLz =X —Ays = 99.5 — 1.427 x 6.218 = 90.63 


UCLz =X +A35 = 99.5 + 1.427 x 6.218 = 108.37 


The completed averages and sigma control charts are shown in Figure 12.2. 
Note that the control limits for the averages chart are only slightly different 
than the limits calculated using ranges. 

Note that the conclusions reached are the same as when ranges were used. 


Control charts for individual measurements (X charts) 
Individuals control charts are statistical tools used to evaluate the central ten- 
dency of a process over time. They are also called X charts or moving range 
charts. Individuals control charts are used when it is not feasible to use averages 
for process control. There are many possible reasons why averages control 
charts may not be desirable: observations may be expensive to get (e.g,, destruc- 
tive testing), output may be too homogeneous over short time intervals (e.g., 
pH of a solution), the production rate may be slow and the interval between suc- 
cessive observations long, etc. Control charts for individuals are often used to 
monitor batch process, such as chemical processes, where the within-batch var- 
iation is so small relative to between-batch variation that the control limits on 
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Figure 12.2. Completed averages and sigma control charts. 


a standard X chart would be too close together. Range charts are used in con- 
junction with individuals charts to help monitor dispersion.* 


*There is considerable debate over the value of moving R charts. Academic researchers have failed to show statistical value in 
them. However, many practitioners (including the author) believe that moving R charts provide valuable additional informa- 


tion that can be used in troubleshooting. 
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Calculations for moving ranges charts 
As with averages and ranges charts, the range is computed as shown above, 


R= Largest in subgroup — Smallest in subgroup 


Where the subgroup is a consecutive pair of process measurements. The 
range control limit is computed as was described for averages and ranges charts, 
using the D, constant for subgroups of 2, which is 3.267. That is, 


LCL = 0 (for n = 2) 
UCL = 3.267 x R-bar 


Control limit equations for individuals charts 


sum of measurements 


X= (12.17) 
number of measurements 

LCL =X —E,R =X —2.66xR (12.18) 

UCL =X +E,R=X+266xR (12.19) 


Where E, = 2.66 is the constant used when individual measurements are 
plotted, and R is based on subgroups of n = 2. 


Example of individuals and moving ranges control charts 

Table 12.3 contains 25 measurements. To facilitate comparison, the 
measurements are the first observations in each subgroup used in the previous 
average/ranges and average/standard deviation control chart examples. 

The control limits are calculated from this data as follows: 


Moving ranges control chart control limits 


- sum of ranges 196 
number of ranges 24 


LCLr = D,R =0 x 8.17 =0 
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Table 12.3. Data for individuals and moving ranges control charts. 


SAMPLE 1 RANGE 


110 
100 


Continued at right ... 


UCLp = D,R = 3.267 X 8.17 = 26.69 


Since it is not possible to have a subgroup range less than zero, the LCLis not 
shown on the control chart for ranges. 


Individuals control chart control limits 


= sum of measurements 2,475 
x= — = 99.0 


number of measurements 25 
LCLy =X — E.R = 99.0 — 2.66 X 8.17 = 77.27 


UCLy =X +E,R = 99.0 + 2.66 x 8.17 = 120.73 


The completed individuals and moving ranges control charts are shown in 
Figure 12.3. 
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Figure 12.3. Completed individuals and moving ranges control charts. 


In this case, the conclusions are the same as with averages charts. However, 
averages charts always provide tighter control than X charts. In some cases, the 
additional sensitivity provided by averages charts may not be justified on either 
an economic or an engineering basis. When this happens, the use of averages 
charts will merely lead to wasting money by investigating special causes that 


are of minor importance. 
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ATTRIBUTE CHARTS 


Control charts for proportion defective (p charts) 

p charts are statistical tools used to evaluate the proportion defective, or 
proportion non-conforming, produced by a process. 

p charts can be applied to any variable where the appropriate performance 
measure is a unit count. p charts answer the question: “Has a special cause of 
variation caused the central tendency of this process to produce an abnormally 
large or small number of defective units over the time period observed?” 


p chart control limit equations 

Like all control charts, p charts consist of three guidelines: center line, a lower 
control limit, and an upper control limit. The center line is the average propor- 
tion defective and the two control limits are set at plus and minus three standard 
deviations. If the process is in statistical control, then virtually all proportions 
should be between the control limits and they should fluctuate randomly 
about the center line. 


subgroup defective count 
p= (12.20) 
subgroup size 


sum of subgroup defective counts 


p= (12.21) 


sum of subgroup sizes 


ae 
LCL =p-—3 cas 2) (12.22) 
n 


UCL = p + 3, po?) (12.23) 


In the above equations, 7 is the subgroup size. If the subgroup sizes varies, the 
control limits will also vary, becoming closer together as 7 increases. 


Analysis of p charts 

As with all control charts, a special cause is probably present if there are any 
points beyond either the upper or the lower control limit. Analysis of p chart 
patterns between the control limits is extremely complicated if the sample size 
varies because the distribution of p varies with the sample size. 
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Example of p chart calculations 

The data in Table 12.4 were obtained by opening randomly selected crates 
from each shipment and counting the number of bruised peaches. There are 
250 peaches per crate. Normally, samples consist of one crate per shipment. 
However, when part-time help is available, samples of two crates are taken. 


Table 12.4. Raw data for p chart. 


SHIPMENT # | CRATES p 
1 1 0.188 
2 1 0.168 
3 1 0.220 
4 1 0.204 
5 1 0.184 
6 1 0.244 
7 1 0.156 
8 1 0.176 
9 1 0.164 
10 1 0.204 
rr 2 0.176 
12 2 0.202 
13 2 0.202 
14 1 250 40 0.160 
15 1 250 48 0.192 
16 1 250 47 0.188 
17 1 250 50 0.200 
18 1 250 48 0.192 
19 1 250 57 0.228 
20 1 250 45 0.180 
21 1 250 43 0.172 
22 2 500 105 0.210 
23 2 500 98 0.196 
24 2 500 100 0.200 
25 2 500 9% 0.192 
TOTALS 8,000 1,544 
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Using the above data the center line and control limits are found as follows: 


subgroup defective count 


subgroup size 


these values are shown in the last column of Table 12.4. 


pi 


sum of subgroup sizes ~ 8,000 


which is constant for all subgroups. 
n = 250 (1 crate): 


7 p(1 — p 0.193 T= O;193 
ECE =9=3 PU ~P) ?) =0.193—3)/ a ) ='0.118 
n 


250 
2 p(1—p 0.193 x (1 — 0.193 
UCL =p +3 HOP _o1943/ ( ) — 0.268 
n 250 
n = 500 (2 crates): 
0.193 x (1 — 0.193) 
LCL = 0.193 — 3 = 0.140 
500 
0.193 x (1 — 0.193) 
UCL = 0.193 +3 500 = 0.246 


The control limits and the subgroup proportions are shown in Figure 12.24. 


Pointers for using p charts 

Determine if “moving control limits” are really necessary. It may be possible 
to use the average sample size (total number inspected divided by the number 
of subgroups) to calculate control limits. For instance, with our example the 
sample size doubled from 250 peaches to 500 but the control limits hardly 
changed at all. Table 12.5 illustrates the different control limits based on 250 
peaches, 500 peaches, and the average sample size which is 8,000+25 = 320 
peaches. 

Notice that the conclusions regarding process performance are the same 
when using the average sample size as they are using the exact sample sizes. 
This is usually the case if the variation in sample size isn’t too great. There are 
many rules of thumb, but most of them are extremely conservative. The best 
way to evaluate limits based on the average sample size is to check it out as 
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Figure 12.4. Completed p control chart. 


shown above. SPC is all about improved decision-making. In general, use the 
most simple method that leads to correct decisions. 


Control charts for count of defectives (np charts) 

np charts are statistical tools used to evaluate the count of defectives, or count 
of items non-conforming, produced by a process. mp charts can be applied to 
any variable where the appropriate performance measure is a unit count and 
the subgroup size is held constant. Note that wherever an np chart can be used, 
a p chart can be used too. 


Table 12.5. Effect of using average sample size. 


SAMPLE SIZE LOWER CONTROL LIMIT UPPER CONTROL LIMIT 


250 0.1181 0.2679 


500 0.1400 0.2460 


320 0.1268 0.2592 
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Control limit equations for np charts 

Like all control charts, np charts consist of three guidelines: center line, a 
lower control limit, and an upper control limit. The center line is the average 
count of defectives-per-subgroup and the two control limits are set at plus and 
minus three standard deviations. If the process is in statistical control, then 
virtually all subgroup counts will be between the control limits, and they will 
fluctuate randomly about the center line. 


np = subgroup defective count (12.24) 


sum of subgroup defective counts 


np = (12.25) 


number of subgroups 
LCL = np — 3,/np( — p) (12.26) 


UCL = np + 3,/np(1 — p) (12.27) 


Note that 


p= (12.28) 


Example of np chart calculation 

The data in Table 12.6 were obtained by opening randomly selected crates 
from each shipment and counting the number of bruised peaches. There are 
250 peaches per crate (constant 7 is required for mp charts). 

Using the above data the center line and control limits are found as follows: 


_ sum of subgroup defective counts 838 
nb = = = 77.93 
number of subgroups 30 


: — 7 
LCL = np — 3\/np( — p) = 27.93 — s,[2793 x (1 — <=) = 12.99 


7 — 27.93 
UCL = np + 3\/np( — p) = 27.93 + ss[2793 x (1 — <) = 42.88 
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Table 12.6. Raw data for mp chart. 


SHIPMENT | BRUISED SHIPMENT | BRUISED 
NUMBER | PEACHES NUMBER | PEACHES 

1 20 16 23 

2 28 17 27 

3 24 18 28 

4 21 19 31 

5 32 20 27 

6 33 21 30 

7 31 22 23 

8 29 23 23 

9 30 24 27 

10 34 25 35 

11 32 26 29 

12 24 27 23 

13 29 28 23 

14 27 29 30 

15 37 30 28 

TOTAL 838 

Continued at right ... 


The control limits and the subgroup defective counts are shown in Figure 
12.5, 


Control charts for average occurrences-per-unit (u charts) 

uw charts are statistical tools used to evaluate the average number of occur- 
rences-per-unit produced by a process. # charts can be applied to any variable 
where the appropriate performance measure is a count of how often a particular 
event occurs. w charts answer the question: “Has a special cause of variation 
caused the central tendency of this process to produce an abnormally large or 
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Figure 12.5. Completed p control chart. 


small number of occurrences over the time period observed?” Note that, unlike 
p or np charts, u charts do not necessarily involve counting physical items. 
Rather, they involve counting of events. For example, when using a p chart one 
would count bruised peaches. When using au chart one would count the bruises. 


Control limit equations for u charts 

Like all control charts, charts consist of three guidelines: center line, a lower 
control limit, and an upper control limit. The center line is the average number 
of occurrences-per-unit and the two control limits are set at plus and minus 
three standard deviations. If the process is in statistical control then virtually 
all subgroup occurrences-per-unit should be between the control limits and 
they should fluctuate randomly about the center line. 


subgroup count of occurrences 
Fe eS a ea ea (12.29) 
subgroup size in units 


sum of subgroup occurrences 
oo (12.30) 


1 


sum of subgroup sizes in units 


LCL =i —3 (12.31) 


Te 
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UCL =u +3 (12.32) 


se 


In the above equations, 7 is the subgroup size in units. If the subgroup size 
varies, the control limits will also vary. 

One way of helping determine whether or not a particular set of data is suit- 
able for aw chart or a p chart is to examine the equation used to compute the 
center line for the control chart. If the unit of measure is the same in both the 
numerator and the denominator, then a p chart is indicated, otherwise a u 
chart is indicated. For example, if 


bruises per crate 


Center Line = 
number of crates 


then the numerator is in terms of bruises while the denominator is in terms of 
crates, indicating au chart. 

The unit size is arbitrary but once determined it cannot be changed without 
recomputing all subgroup occurrences-per-unit and control limits. For exam- 
ple, if the occurrences were accidents and a unit was 100,000 hours worked, 
then a month with 250,000 hours worked would be 2.5 units and a month with 
50,000 hours worked would be 0.5 units. If the unit size were 200,000 hours 
then the two months would have 1.25 and 0.25 units respectively. The equations 
for the center line and control limits would “automatically” take into account 
the unit size, so the control charts would give identical results regardless of 
which unit size is used. 


Analysis of u charts 

As with all control charts, a special cause is probably present if there are any 
points beyond either the upper or the lower control limit. Analysis of u chart 
patterns between the control limits is extremely complicated when the sample 
size varies and is usually not done. 


Example of u chart 

The data in Table 12.7 were obtained by opening randomly selected crates 
from each shipment and counting the number of bruises on peaches. There are 
250 peaches per crate. Our unit size will be taken as one full crate, i.e., we will 
be counting crates rather than the peaches themselves. Normally, samples 
consist of one crate per shipment. However, when part-time help is available, 
samples of two crates are taken. 


414 STATISTICAL PROCESS CONTROL TECHNIQUES 


Table 12.7. Raw data for u chart. 


SHIPMENT NO. | UNITS (CRATES) FLAWS FLAWS-PER-UNIT 

1 1 47 47 

2 1 42 42 

3 1 55 55 

4 1 51 51 

5 1 46 46 

6 1 61 61 

7 1 39 39 

8 1 44 44 

9 1 41 41 
10 1 51 51 
11 2 88 44 
12 2 101 50.5 
13 2. 101 50.5 
14 1 40 40 
15 1 48 48 
16 1 47 47 
17 1 50 50 
18 1 48 48 
19 1 57 57 
20 1 45 45 
21 1 43 43 
De 2 105 52.5 
23 2 98 49 
24 2. 100 50 
25 2 96 48 

TOTALS 32 1,544 
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Using the above data the center line and control limits are found as follows: 


subgroup count of occurrences 


subgroup size in units 
These values are shown in the last column of Table 12.7. 


_ _ sum of subgroup count of occurrences _ _1 5544 sis 
4= = 48. 
sum of subgroup unit sizes 32 


which is constant for all subgroups. 


n = unit: 


_, fi 48.25 
ite Af ges = 27.411 
n 


y u 48.25 
UCL =u + 3,/— = 48.25 +3 = 69.089 
n 


n = 2units: 


48.25 

LCL = 48.25 — 3 a = 33.514 
48.25 

UCL = 48.25 + 3 att = 62.986 


The control limits and the subgroup occurrences-per-unit are shown in 
Figure 12.6. 

The reader may note that the data used to construct the w chart were the same 
as those used for the p chart, except that we considered the counts as being 
counts of occurrences (bruises) instead of counts of physical items (bruised pea- 
ches). The practical implications of using a # chart when a p chart should have 
been used, or vice versa, are usually not serious. The decisions based on the con- 
trol charts will be quite similar in most cases encountered in Six Sigma regard- 
less of whether a uv or ap chart is used. 


416 


STATISTICAL PROCESS CONTROL TECHNIQUES 


OCCURRENCES-PER-UNIT CONTROL CHART 
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Figure 12.6. Completed u control chart. 


Control charts for counts of occurrences-per-unit (c charts) 

c charts are statistical tools used to evaluate the number of occurrences-per- 
unit produced by a process. c charts can be applied to any variable where the 
appropriate performance measure is a count of how often a particular event 
occurs and samples of constant size are used. c charts answer the question: 
“Has a special cause of variation caused the central tendency of this process to 
produce an abnormally large or small number of occurrences over the time per- 
iod observed?” Note that, unlike p orp charts, c charts do not involve counting 
physical items. Rather, they involve counting of events. For example, when 
using an mp chart one would count bruised peaches. When using ac chart one 
would count the bruises. 


Control limit equations for c charts 

Like all control charts, c charts consist of three guidelines: center line, a lower 
control limit, and an upper control limit. The center line is the average number 
of occurrences-per-unit and the two control limits are set at plus and minus 
three standard deviations. If the process is in statistical control then virtually 
all subgroup occurrences-per-unit should be between the control limits and 
they should fluctuate randomly about the center line. 
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sum of subgroup occurrences 


c= 12.33 
. number of subgroups ( ) 
LCL =¢ —3V¢ (12.34) 
UCL =¢ +3Ve (12.35) 


One way of helping determine whether or not a particular set of data is suit- 
able for ac chart or an np chart is to examine the equation used to compute the 
center line for the control chart. If the unit of measure is the same in both the 
numerator and the denominator, then a p chart is indicated, otherwise ac chart 
is indicated. For example, if 


; bruises 
Center Line = ——————_ 
number of crates 
then the numerator is in terms of bruises while the denominator is in terms of 
crates, indicating ac chart. 
The unit size is arbitrary but, once determined, it cannot be changed without 
recomputing all subgroup occurrences-per-unit and control limits. 


Analysis of c charts 

As with all control charts, a special cause is probably present if there are any 
points beyond either the upper or the lower control limit. Analysis of c chart 
patterns between the control limits is shown later in this chapter. 


Example of c chart 

The data in Table 12.8 were obtained by opening randomly selected crates 
from each shipment and counting the number of bruises. There are 250 peaches 
per crate. Our unit size will be taken as one full crate, i.e., we will be counting 
crates rather than the peaches themselves. Every subgroup consists of one 
crate. If the subgroup size varied, a u chart would be used. 

Using the above data the center line and control limits are found as follows: 


sum of subgroup occurrences 1,006 
———— = 33.53 


c= = 
number of subgroups 30 


LCL =¢ — 3V¢ = 33.53 — 3s/33.53 = 16.158 
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Table 12.8. Raw data for c chart. 


SHIPMENT # FLAWS SHIPMENT # FLAWS 
1 27 16 29 
2 32 17 33 
3 24 18 33 
4 31 19 38 
5 42 20 32 
6 38 21 37 
7 33 22 30 
8 35 23 31 
9 35 24 32 

10 39 25 42 
11 41 26 40 
12 29 27 21 
13 34 28 23 
14 34 29 39 
15 43 30 29 

TOTAL 1,006 

Continued at right ... 


UCL = ¢ + 34/8¢ = 33.53 + 3\/33.53 = 50.902 


The control limits and the occurrence counts are shown in Figure 12.7. 


CONTROL CHART SELECTION 


Selecting the proper control chart for a particular data set is a simple matter if 
approached properly. The proper approach is illustrated in Figure 12.8. 

To use the decision tree, begin at the left-most node and determine if the data 
are measurements or counts. If measurements, then select the control chart 
based on the subgroup size. If the data are counts, then determine if the counts 
are of occurrences or pieces. An aid in making this determination is to examine 
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Figure 12.7. Completed c control chart. 


the equation for the process average. If the numerator and denominator involve 
the same units, then a p or np chart is indicated. If different units of measure 
are involved, then a u orc chart is indicated. For example, if the average is in 
accidents-per-month, then ac or u chart is indicated because the numerator is 
in terms of accidents but the denominator is in terms of time. 


Average, Range 
Average, Sigma 
Run Chart 

X Control Chart 

np Control Chart 
P Chart 


C Chart 


u Chart 


Figure 12.8. Control chart selection decision tree. 
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RATIONAL SUBGROUP SAMPLING 


The basis of all control charts is the rational subgroup. Rational subgroups 
are composed of items which were produced under essentially the same con- 
ditions. The statistics, for example, the average and range, are computed for 
each subgroup separately, then plotted on the control chart. When possible, 
rational subgroups are formed by using consecutive units. Each subgroup’s 
statistics are compared to the control limits, and patterns of variation between 
subgroups are analyzed. Note the sharp contrast between this approach and 
the random sampling approach used for enumerative statistical methods. 

The idea of rational subgrouping becomes a bit fuzzy when dealing with x 
charts, or individuals control charts. The reader may well wonder about the 
meaning of the term subgrouping when the “subgroup” is a single measure- 
ment. The basic idea underlying control charts of all types is to identify the 
capability of the process. The mechanism by which this is accomplished is care- 
ful formation of rational subgroups as defined above. When possible, rational 
subgroups are formed by using consecutive units. The measure of process varia- 
bility, either the subgroup standard deviation or the subgroup range, is the 
basis of the control limits for averages. Conceptually, this is akin to basing the 
control limits on short-term variation. These control limits are used to monitor 
variation over time. 

As far as possible, this approach also forms the basis of establishing control 
limits for individual measurements. This is done by forming quasi-subgroups 
using pairs of consecutive measurements. These “subgroups of 2” are used to 
compute ranges. The ranges are used to compute the control limits for the 
individual measurements. 


CONTROL CHART INTERPRETATION 


Control charts provide the operational definition of the term special cause. A 
special cause is simply anything which leads to an observation beyond a control 
limit. However, this simplistic use of control charts does not do justice to their 
power. Control charts are running records of the performance of the process 
and, as such, they contain a vast store of information on potential improve- 
ments. While some guidelines are presented here, control chart interpretation 
is an art that can only be developed by looking at many control charts and prob- 
ing the patterns to identify the underlying system of causes at work. 

Freak patterns are the classical special cause situation (Figure 12.9). Freaks 
result from causes that have a large effect but that occur infrequently. When 
investigating freak values look at the cause and effect diagram for items that 
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Figure 12.9. Control chart patterns: freaks. 


meet these criteria. The key to identifying freak causes is timelines in collecting 
and recording the data. If you have difficulty, try sampling more frequently. 

Drift is generally seen in processes where the current process value is partly 
determined by the previous process state. For example, if the process is a plating 
bath, the content of the tank cannot change instantaneously, instead it will 
change gradually (Figure 12.10). Another common example is tool wear: the 
size of the tool is related to its previous size. Once the cause of the drift has 
been determined, the appropriate action can be taken. Whenever economically 
feasible, the drift should be eliminated, e.g., install an automatic chemical dis- 
penser for the plating bath, or make automatic compensating adjustments to 
correct for tool wear. Note that the total process variability increases when 
drift is allowed, which adds cost. When drift elimination is not possible, the con- 
trol chart can be modified in one of two ways: 

1. Make the slope of the center line and control limits match the natural 
process drift. The control chart will then detect departures from the 
natural drift. 

2. Plot deviations from the natural or expected drift. 

Cycles often occur due to the nature of the process. Common cycles include 
hour of the day, day of the week, month of the year, quarter of the year, week of 
the accounting cycle, etc. (Figure 12.11). Cycles are caused by modifying the pro- 
cess inputs or methods according toa regular schedule. The existence of this sche- 
dule and its effect on the process may or may not be known in advance. Once 
the cycle has been discovered, action can be taken. The action might be to adjust 
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Figure 12.10. Control chart patterns: drift. 


the control chart by plotting the control measure against a variable base. For 
example, if a day-of-the-week cycle exists for shipping errors because of the work- 
load, you might plot shipping errors per 100 orders shipped instead of shipping 
errors per day. Alternatively, it may be worthwhile to change the system to 
smooth out the cycle. Most processes operate more efficiently when the inputs 


are relatively stable and when methods are changed as little as possible. 


Figure 12.11. Control chart patterns: cycles. 
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Figure 12.12. Control chart patterns: repeating patterns. 


A controlled process will exhibit only “random looking” variation. A pattern 
where every nth item is different is, obviously, non-random (Figure 12.12). 
These patterns are sometimes quite subtle and difficult to identify. It is some- 
times helpful to see if the average fraction defective is close to some multiple of 
a known number of process streams. For example, if the machine is a filler 
with 40 stations, look for problems that occur 1/40, 2/40, 3/40, etc., of the time. 

When plotting measurement data the assumption is that the numbers exist 
on a continuum, ie., there will be many different values in the data set. In the 
real world, the data are never completely continuous (Figure 12.13). It usually 
doesn’t matter much if there are, say, 10 or more different numbers. However, 
when there are only a few numbers that appear over-and-over it can cause 


Figure 12.13. Control chart patterns: discrete data. 
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problems with the analysis. A common problem is that the R chart will under- 
estimate the average range, causing the control limits on both the average 
and range charts to be too close together. The result will be too many “false 
alarms” and a general loss of confidence in SPC. 

The usual cause of this situation is inadequate gage resolution. The ideal solu- 
tion is to obtain a gage with greater resolution. Sometimes the problem occurs 
because operators, inspectors, or computers are rounding the numbers. The 
solution here is to record additional digits. 

The reason SPC is done is to accelerate the learning process and to eventually 
produce an improvement. Control charts serve as historical records of the learn- 
ing process and they can be used by others to improve other processes. When 
an improvement is realized the change should be written on the old control 
chart; its effect will show up as a less variable process. These charts are also use- 
ful in communicating the results to leaders, suppliers, customers, and others 
interested in quality improvement (Figure 12.14). 


BEFORE CHANGE AFTER CHANGE 


Figure 12.14. Control chart patterns: planned changes. 


Seemingly random patterns on a control chart are evidence of unknown 
causes of variation, which is not the same as uncaused variation. There should 
be an ongoing effort to reduce the variation from these so-called common causes. 
Doing so requires that the unknown causes of variation be identified. One way 
of doing this is a retrospective evaluation of control charts. This involves brain- 
storming and preparing cause and effect diagrams, then relating the control 
chart patterns to the causes listed on the diagram. For example, if “operator” is 
a suspected cause of variation, place a label on the control chart points produced 
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by each operator (Figure 12.15). If the labels exhibit a pattern, there is evidence to 
suggest a problem. Conduct an investigation into the reasons and set up con- 
trolled experiments (prospective studies) to test any theories proposed. If the 
experiments indicate a true cause and effect relationship, make the appropriate 
process improvements. Keep in mind that a statistical association is not the 
same thing as a causal correlation. The observed association must be backed up 
with solid subject-matter expertise and experimental data. 

Mixture exists when the data from two different cause systems are plotted on 
a single control chart (Figure 12.16). It indicates a failure in creating rational 


Figure 12.16. Control chart patterns: mixture. 
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subgroups. The underlying differences should be identified and corrective 
action taken. The nature of the corrective action will determine how the control 


chart should be modified. 


Mixture example 7/1 

The mixture represents two different operators who can be made more 
consistent. A single control chart can be used to monitor the new, consistent 
process. 


Mixture example #2 

The mixture is in the number of emergency room cases received on Saturday 
evening, versus the number received during a normal week. Separate control 
charts should be used to monitor patient-load during the two different time 
periods. 


RULES FOR DETERMINING STATISTICAL CONTROL 


Run tests 

If the process is stable, then the distribution of subgroup averages will be 
approximately normal. With this in mind, we can also analyze the patterns on 
the control charts to see if they might be attributed to a special cause of vari- 
ation. To do this, we divide a normal distribution into zones, with each zone 
one standard deviation wide. Figure 12.17 shows the approximate percentage 
we expect to find in each zone from a stable process. 

Zone C is the area from the mean to the mean plus or minus one sigma, zone 
B is from plus or minus one sigma to plus or minus two sigma, and zone A is 
from plus or minus two sigma to plus or minus three sigma. Of course, any 
point beyond three sigma (i.e., outside of the control limit) is an indication of 
an out-of-control process. 

Since the control limits are at plus and minus three standard deviations, find- 
ing the one and two sigma lines ona control chart is as simple as dividing the dis- 
tance between the grand average and either control limit into thirds, which can 
be done using a ruler. This divides each half of the control chart into three 
zones. The three zones are labeled A, B, and C as shown on Figure 12.18. 

Based on the expected percentages in each zone, sensitive run tests can be 
developed for analyzing the patterns of variation in the various zones. 
Remember, the existence of a non-random pattern means that a special cause 
of variation was (or is) probably present. The averages, mp and c control chart 
run tests are shown in Figure 12.19. 
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A B Cc Cc B A 
2.14% 13.59% 34.13% 34.13% 13.59% 2.14% 


-30 20 -lo be +lo +20 +30 

Figure 12.17. Percentiles for a normal distribution. 
Note that, when a point responds to an out-of-control test it is marked 
with an “X” to make the interpretation of the chart easier. Using this 


convention, the patterns on the control charts can be used as an aid in trouble- 
shooting. 
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Figure 12.18. Zones on a control chart. 
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Figure 12.19. Tests for out-of-control patterns on control charts. 
From “The Shewhart Control Chart—Tests for Special Causes,” Journal of Quality 
Technology, 16(4), p.238. Copyright © 1986 by Nelson. 
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TAMPERING EFFECTS AND DIAGNOSIS 


Tampering occurs when adjustments are made to a process that is in statisti- 
cal control. Adjusting a controlled process will always increase process variabil- 
ity, an obviously undesirable result. The best means of diagnosing tampering is 
to conduct a process capability study (see Chapter 13) and to use a control 
chart to provide guidelines for adjusting the process. 

Perhaps the best analysis of the effects of tampering is from Deming (1986). 
Deming describes four common types of tampering by drawing the analogy of 
aiming a funnel to hit a desired target. These “funnel rules” are described by 
Deming (1986, p. 328): 

1. “Leave the funnel fixed, aimed at the target, no adjustment.” 

2. “At drop k (k = 1, 2, 3,...) the marble will come to rest at point z, 

measured from the vatoee vce other words, zz is the error at drop k) 
Move the funnel the distance —z, from the last position. Memory 1.” 

3. “Set the funnel at each drop right over the spot zz, measured from the 

target. No memory.” 

4. “Set the funnel at each drop right over the spot (z,) where it last came to 

rest. No memory.” 

Rule #1 is the best rule for stable processes. By following this rule, the pro- 
cess average will remain stable and the variance will be minimized. Rule #2 pro- 
duces a stable output but one with twice the variance of rule #41. Rule #73 
results in a system that “explodes,” i-e., a symmetrical pattern will appear with 
a variance that increases without bound. Rule #4 creates a pattern that steadily 
moves away from the target, without limit (see figure 12.20). 

At first glance, one might wonder about the relevance of such apparently 
abstract rules. However, upon more careful consideration, one finds many prac- 
tical situations where these rules apply. 

Rule #1 is the ideal situation and it can be approximated by using control 
charts to guide decision-making. If process adjustments are made only when 
special causes are indicated and identified, a pattern similar to that produced 
by rule #1 will result. 

Rule #72 has intuitive appeal for many people. It is commonly encountered 
in such activities as gage calibration (check the standard once and adjust the 
gage accordingly) or in some automated equipment (using an automatic gage, 
check the size of the last feature produced and make a compensating adjust- 
ment). Since the system produces a stable result, this situation can go unnoticed 
indefinitely. However, as shown by Taguchi (1986), increased variance trans- 
lates to poorer quality and higher cost. 

The rationale that leads to rule #43 goes something like this: “A measurement 
was taken and it was found to be 10 units above the desired target. This hap- 
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pened because the process was set 10 units too high. I want the average to equal 
the target. To accomplish this I must try to get the next unit to be 10 units too 
low.” This might be used, for example, in preparing a chemical solution. While 
reasonable on its face, the result of this approach is a wildly oscillating system. 

A common example of rule #4 is the “train-the-trainer” method. A master 
spends a short time training a group of “experts,” who then train others, who 
train others, etc. An example is on-the-job training. Another is creating a setup 
by using a piece from the last job. Yet another is a gage calibration system 
where standards are used to create other standards, which are used to create 
still others, and so on. Just how far the final result will be from the ideal depends 
on how many levels deep the scheme has progressed. 


1-50 Rule #1 101-150 Rule #3 
51-100 Rule #2 151-200 Rule #4 


200 


Figure 12.20. Funnel rule simulation results. 


SHORT RUN STATISTICAL PROCESS CONTROL 
TECHNIQUES 


Short production runs are a way of life with many manufacturing companies. 
In the future, this will be the case even more often. The trend in manufacturing 
has been toward smaller production runs with product tailored to the specific 
needs of individual customers. Henry Ford’s days of “the customer can have 
any color, as long as it’s black” have long since passed. 

Classical SPC methods, such as X and R charts, were developed in the era of 
mass production of identical parts. Production runs often lasted for weeks, 
months, or even years. Many of the “SPC rules of thumb” currently in use 
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were created for this situation. For example, the rule that control limits not be 
calculated until data are available from at least 25 subgroups of 5. This may not 
have been a problem in 1930, but it certainly is today. In fact, many entire pro- 
duction runs involve fewer parts than required to start a standard control chart! 

Many times the usual SPC methods can be modified slightly to work with 
short and small runs. For example, X and R control charts can be created 
using moving averages and moving ranges (Pyzdek, 1989). However, there 
are SPC methods that are particularly well suited to application on short or 
small runs. 


VARIABLES DATA 


Variables data, sometimes called continuous data, involve measurements 
such as size, weight, pH, temperature, etc. In theory data are variables data if 
no two values are exactly the same. In practice this is seldom the case. As a 
rough rule of thumb you can consider data to be variables data if at least ten dif- 
ferent values occur and repeat values make up no more than 20% of the data 
set. If this is not the case, your data may be too discrete to use standard control 
charts. Consider trying an attribute procedure such as the demerit charts 
described later in this chapter. We will discuss the following approaches to 
SPC for short or small runs: 

1. Exact method—Tables of special control chart constants are used to 
create X,X, and R charts that compensate for the fact that a limited num- 
ber of subgroups are available for computing control limits. The exact 
method is also used to compute control limits when using a code value 
chart or stabilized X or X and R charts (see below). The exact method 
allows the calculation of control limits that are correct when only a 
small amount of data is available. As more data become available the 
exact method updates control limits until, finally, no further updates 
are required and standard control chart factors can be used (Pyzdek, 
1992a). 

2. Code value charts—Control charts created by subtracting nominal or 
other target values from actual measurements. These charts are often 
standardized so that measurement units are converted to whole num- 
bers. For example, if measurements are in thousandths of an inch a read- 
ing of 0.011 inches above nominal would be recorded simply as “11.” 
Code value charts enable the user to plot several parts from a given pro- 
cess on a single chart, or to plot several features from a single part on 
the same control chart. The exact method can be used to adjust the con- 
trol limits when code value charts are created with limited data. 
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3. Stabilized control charts for variables—Statisticians have known 
about normalizing transformations for many years. This approach can 
be used to create control charts that are independent of the unit of mea- 
sure and scaled in such a way that several different characteristics can 
be plotted on the same control chart. Since stabilized control charts are 
independent of the unit of measure, they can be thought of as true 
process control charts. The exact method adjusts the control limits for sta- 
bilized charts created with limited data. 


EXACT METHOD OF COMPUTING CONTROL LIMITS 


FOR SHORT AND SMALL RUNS 

This procedure, adapted from Hillier (1969) and Proschan and Savage (1960), 
applies to short runs or any situation where a small number of subgroups will 
be used to set up a control chart. It consists of three stages: 

1. finding the process (establishing statistical control); 

2. setting limits for the remainder of the initial run; and 

3. _ setting limits for future runs. 

The procedure correctly compensates for the uncertainties involved when 
computing control limits with small amounts of data. 


Stage one: find the process 

1. Collect an initial sample of subgroups (g). The factors for the recom- 
mended minimum number of subgroups are shown in Appendix Table 
15 enclosed in a dark box. If it is not possible to get the minimum number 
of subgroups, use the appropriate control chart constant for the number 
of subgroups you actually have. 

2. Using Table 15 compute the Range chart control limits using the equa- 
tion Upper Control Limit for Ranges (UCL) = D4: x R. Compare 
the subgroup ranges to the UCL and drop any out-of-control groups. 
Repeat the process until all remaining subgroup ranges are smaller than 
UCL. - 

3. Using the R value found in step #42, compute the control limits 
for the averages or individuals chart. The control limits are found 
by adding and subtracting Ay; x R from the overall average. Drop 
any subgroups that have out-of-control averages and recompute. 
Continue until all remaining values are within the control limits. 
Go to stage two. 
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Stage two: set limits for remainder of the initial run 
1. Using Table 15 compute the control limits for the remainder of the run. 
Use the Aj factors for the X chart and the Dy4g factors for the R chart; 
g = the number of groups used to compute stage one control limits. 


Stage three: set limits for a future run 
1. After the run is complete, combine the raw data from the entire run and 
perform the analysis as described in stage one above. Use the results of 
this analysis to set limits for the next run, following the stage two proce- 
dure. If more than 25 groups are available, use a standard table of control 
chart constants. 


Notes 

1. Stage three assumes that there are no special causes of variation between 
runs. If there are, the process may go out of control when using the 
stage three control limits. In these cases, remove the special causes. If 
this isn’t possible, apply this procedure to each run separately (i.e., start 
over each time). 

2. This approach will lead to the use of standard control chart tables when 
enough data are accumulated. 

3. The control chart constants for the first stage are Azz and Dyp (the “FP” 
subscript stands for First stage); for the second stage use Azs and D4s. 
These factors correspond to the A, and D, factors usually used, except 
that they are adjusted for the small number of subgroups actually avail- 


able. 


Setup approval procedure 

The following procedure can be used to determine if a setup is acceptable 
using a relatively small number of sample units. 

1. After the initial setup, run 3 to 10 pieces without adjusting the process. 

2. Compute the average and the range of the sample. 


average — target 
3. Compute T = 


range 


Use absolute values (i.e., ignore any minus signs). The target value is 
usually the specification midpoint or nominal. 
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4. If Tis less than the critical T in Table 12.9 accept the setup. Otherwise 
adjust the setup to bring it closer to the target. NOTE: there is approxi- 
mately 1 chance in 20 that an on-target process will fail this test. 


Table 12.9. Critical value for setup acceptance. 


n 


3 4 


5 


6 


7 


8 


9 


10 


Critical T 0.885 0.529 0.388 


0.312 


0.263 0.230 0.205 


0.186 


Example 
Assume we wish to use SPC for a process that involves producing a part in 
lots of 30 parts each. The parts are produced approximately once each month. 
The control feature on the part is the depth of a groove and we will be measuring 
every piece. We decide to use subgroups of size three and to compute the stage 
one control limits after the first five groups. The measurements obtained are 


shown in Table 12.10. 


Using the data in Table 12.10 we can compute the grand average and average 
range as 


Grand average = 0.10053 


Average range (R) = 0.00334 


Table 12.10. Raw data for example of exact method. 


SUBGROUP | SAMPLE NUMBER 
NUMBER ; 4 R 
1 0.0989 | 0.0986 | 0.1031 | 0.1002 | 0.0045 
2 0.0986 | 0.0985 | 0.1059 | 0.1010 | 0.0074 
3 0.1012 | 0.1004 | 0.1000 | 0.1005 | 0.0012 
4 0.1023 | 0.1027 | 0.1000 | 0.1017 | 0.0027 
5 0.0992 | 0.0997 | 0.0988 | 0.0992 | 0.0009 


Statistical process control (SPC) 435 


From Appendix Table 15 we obtain the first stage constant for the range 
chart of Dyp = 2.4 in the row for g = 5 groups and a subgroup size of 3. Thus, 


UCLz = Dy: X R = 2.4 X 0.00334 = 0.0080 


All of the ranges are below this control limit, so we can proceed to the analy- 
sis of the averages chart. If any R was above the control limit, we would try to 
determine why before proceeding. 

For the averages chart we get 


LCLz = grand average — Ay, X R 
= 0.10053 — 1.20 x 0.00334 = 0.09652 (rounded) 


UCL; = grand average +.Ay¢ x R 
= 0.10053 + 1.20 x 0.00334 = 0.10454 (rounded) 


All of the subgroup averages are between these limits. Now setting limits for 
the remainder of the run we use Dys = 3.4 and Aj, = 1.47. This gives, after 
rounding, 


UCL z = 0.01136 
LCLz = 0.09562 
UCLz = 0.10544 


If desired, this procedure can be repeated when a larger number of subgroups 
becomes available, say 10 groups. This would provide somewhat better esti- 
mates of the control limits, but it involves considerable administrative over- 
head. When the entire run is finished you will have 10 subgroups of 3 per 
subgroup. The data from all of these subgroups should be used to compute 
stage one and stage two control limits. The resulting stage two control limits 
would then be applied to the next run of this part number. 

By applying this method in conjunction with the code value charts or 
stabilized charts described below, the control limits can be applied to the next 
parts produced on this process (assuming the part-to-part difference can be 
made negligible). Note that if the standard control chart factors were used the 
limits for both stages would be (values are rounded) 


UCL z = 0.00860 
LCL; = 0.09711 
UCL xz = 0.10395 
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As the number of subgroups available for computing the control limits 
increases, the “short run” control limits approach the standard control limits. 
However, if the standard control limits are used when only small amounts of 
data are available there is a greater chance of erroneously rejecting a process 
that is actually in control (Hillier, 1969). 


CODE VALUE CHARTS 


This procedure allows the control of multiple features with a single control 
chart. It consists of making a simple transformation to the data, namely 


X — Target 


! (12.36) 
unit of measure 


x= 


The resulting x values are used to compute the control limits and as plotted 
points on the X and R charts. This makes the target dimension irrelevant for 
the purposes of SPC and makes it possible to use a single control chart for 
several different features or part numbers. 


Example 

A lathe is used to produce several different sizes of gear blanks, as is indicated 
in Figure 12.21. 

Product engineering wants all of the gear blanks to be produced as near as 
possible to their nominal size. Process engineering believes that the process 
will have as little deviation for larger sizes as it does for smaller sizes. Quality 
engineering believes that the inspection system will produce approximately 
the same amount of measurement error for larger sizes as for smaller sizes. 
Process capability studies and measurement error studies confirm these 
assumptions. (I hope you are starting to get the idea that a number of assump- 
tions are being made and that they must be valid before using code value charts.) 

Based on these conclusions, the code value chart is recommended. By using 
the code value chart the amount of paperwork will be reduced and more data 
will be available for setting control limits. Also, the process history will be easier 
to follow since the information won’t be fragmented among several different 
charts. The data in Table 12.11 show some of the early results. 

Note that the process must be able to produce the tightest tolerance of 
0.0005 inches. The capability analysis should indicate its ability to do this; 
ie., C,, should be at least 1.33 based on the tightest tolerance. It will not be 
allowed to drift or deteriorate when the less stringently toleranced parts are pro- 
duced. Process control is independent of the product requirements. Permitting 
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Process t=+0.0001 


o=0.0001 
140.0010 A A: Cp=3.33, Cpk=3.00 
0.5+0.0005 B B: Cp=1.67, Cpk=1.33 
A 
2+0.0015 Cc C: Cp=5.00, Cpk=4.67 
Y 


Figure 12.21. Some of the gear blanks to be machined. 


Table 12.11. Deviation from target in hundred-thousandths. 


SAMPLE NUMBER 

PART NOMINAL NO. 1 2 3 xX R 
A 1.0000 1 4 3 25 10.7 22 
2 3 3 39 15.0 36 

3 16 12 10 12.7 6 

B 0.5000 4 21 24 10 18.3 14 
5 6 8 4 6.0 4 

6 19 7 21 15.7 14 

c 2.0000 7 1 11 4 5.3 10 
8 1 25 8 11.3 24 

9 6 8 ? 7.0 2 
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the process to degrade to its worst acceptable level (from the product perspec- 
tive) creates engineering nightmares when the more tightly toleranced parts 
come along again. It also confuses and demoralizes operators and others trying 
to maintain high levels of quality. In fact, it may be best to publish only the pro- 
cess performance requirements and to keep the product requirements secret. 

The control chart of the data in Table 12.11 is shown in Figure 12.22. Since 
only nine groups were available, the exact method was used to compute the con- 
trol limits. Note that the control chart shows the deviations on the X and R 
chart axes, not the actual measured dimensions, e.g., the value of Part A, sub- 
group #1, sample #1 was +0.00004" from the target value of 1.0000" and it is 
shown as a deviation of +4 hundred-thousandths; ie. the part checked 
1.00004". The stage one control chart shows that the process is obviously in sta- 
tistical control, but it is producing parts that are consistently too large regard- 
less of the nominal dimension. If the process were on target, the grand average 
would be very close to 0. The setup problem would have been detected by the 
second subgroup if the setup approval procedure described earlier in this chap- 
ter had been followed. 


CODE VALUE SPC CHART 
Deviations from nominal in hundred-thousandths 


UCL 


Average 


Averages 


LCL 


Graphic by 
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08/2190 8:32pm CODE_DOT, DIAMETER 


Figure 12.22. Code value chart of Table 12.11 data. 
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This ability to see process performance across different part numbers is one 
of the advantages of code value charts. It is good practice to actually identify 
the changes in part numbers on the charts, as is done in Figure 12.22. 


STABILIZED CONTROL CHARTS FOR VARIABLES 


All control limits, for standard sized runs or short and small runs, are based 
on methods that determine if a process statistic falls within limits that might 
be expected from chance variation (common causes) alone. In most cases, the 
statistic is based on actual measurements from the process and it is in the same 
unit of measure as the process measurements. As we saw with code value charts, 
it is sometimes useful to transform the data in some way. With code value charts 
we used a simple transformation that removed the effect of changing nominal 
and target dimensions. While useful, this approach still requires that all mea- 
surements be in the same units of measurement, e.g., all inches, all grams, etc. 
For example, all of the variables on the control chart for the different gear 
blanks had to be in units of hundred-thousandths of an inch. If we had also 
wanted to plot, for example, the perpendicularity of two surfaces on the gear 
blank we would have needed a separate control chart because the units would 
be in degrees instead of inches. 

Stabilized control charts for variables overcome the units of measure prob- 
lem by converting all measurements into standard, non-dimensional units. 
Such “standardizing transformations” are not new, they have been around for 
many years and they are commonly used in all types of statistical analyses. The 
two transformations we will be using here are shown in Equations 12.37 and 
12.38. 


(X — grand average) 


3 (12.37) 


(12.38) 


| 


As you can see, Equation 12.37 involves subtracting the grand average from 
each subgroup average (or from each individual measurement if the subgroup 
size is one) and dividing the result by R. Note that this is not the usual statistical 
transformation where the denominator is 0. By using R as our denominator 
instead of s we are sacrificing some desirable statistical properties such as nor- 
mality and independence to gain simplicity. However, the resulting control 
charts remain valid and the false alarm risk based on points beyond the control 
limits is identical to standard control charts. Also, as with all transformations, 
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this approach suffers in that it involves plotting numbers that are not in the 
usual engineering units people are accustomed to working with. This makes it 
more difficult to interpret the results and spot data entry errors. 

Equation 12.38 divides each subgroup range by the average range. Since the 
numerator and denominator are both in the same unit of measurement, the 
unit of measurement cancels and we are left with a number that is in terms of 
the number of average ranges, R’s. It turns out that control limits are also in 
the same units, i.e., to compute standard control limits we simply multiply R 
by the appropriate table constant to determine the width between the control 
limits. 

Hillier (1969) noted that this is equivalent to using the transformations 
shown in Equations 12.37 and 12.38 with control limits set at 


(X — grand average) e 


—A, < a 


A, (12.39) 


for the individuals or averages chart. Control limits are 


D,<==D, (12.40) 


il Be 


for the range chart. Duncan (1974) described a similar transformation for attri- 
bute charts, p charts in particular (see below), and called the resulting chart a 
“stabilized p chart.” We will call charts of the transformed variables data stabi- 
lized charts as well. 

Stabilized charts allow you to plot multiple units of measurement on the 
same control chart. The procedure described in this chapter for stabilized vari- 
ables charts requires that all subgroups be of the same size.* The procedure for 
stabilized attribute charts, described later in this chapter allows varying sub- 
group sizes. When using stabilized charts the control limits are always fixed. 
The raw data are “transformed” to match the scale determined by the control 
limits. When only limited amounts of data are available, the constants in 
Appendix Table 15 should be used for computing control limits for stabilized 
variables charts. As more data become available, the Appendix Table 11 con- 
stants approach the constants in standard tables of control chart factors. Table 
12.12 summarizes the control limits for stabilized averages, stabilized ranges, 
and stabilized individuals control charts. The values for A>, D3, and D4 can be 
found in standard control chart factor tables. 


* The procedure for stabilized attribute charts, described later in this chapter, allows varying subgroup sizes. 
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Table 12.12. Control limits for stabilized charts. 


AVAILABLE APPENDIX 

STAGE GROUPS TABLE 

One 25 or less 15 

Two 25 or less 15 
Average 0) 1 0 
UCL +Axs | Das | +Aas 

One More than LCL —A> D; —2.66 11 

or 25 

Two Average 0 1 0 

Example 


A circuit board is produced on an electroplating line. Three parameters are 
considered important for SPC purposes: lead concentration of the solder plating 
bath, plating thickness, and resistance. Process capability studies have been 
done using more than 25 groups; thus, based on Table 12.12 the control limits are 


—A, <X <A, 
for the averages control chart, and 
Dy RZD, 


for the ranges control chart. The actual values of the constants Aj, D3, and D, 
depend on the subgroup size; for subgroups of three A, = 1.023, D; = 0 and 
D, = 2.574. 
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Table 12.13. Process capabilities for example. 


FEATURE CODE FEATURE GRAND AVG. | AVG.RANGE 
A Lead % 10% 1% 
B Plating thickness 0.005" 0.0005" 
C Resistance 0.122 0.000522 


The capabilities are shown in Table 12.13. 

A sample of three will be taken for each feature. The three lead concentration 
samples are taken at three different locations in the tank. The results of one 
such set of sample measurements is shown in Table 12.14, along with their stabi- 
lized values. 

On the control chart only the extreme values are plotted. Figure 12.23 shows a 
stabilized control chart for several subgroups. Observe that the feature respon- 
sible for the plotted point is written on the control chart. If a long series of 


Table 12.14. Sample data for example. 


NUMBER LEAD % (A) THICKNESS (B) RESISTANCE (C) 
1 11% 0.0050" 0.10002 
2 11% 0.0055" 0.10102 
3 8% 0.0060" 0.10202 
Xx 10% 0.0055" 0.10102 
R 3% 0.0010" 0.00202 
Came x)/R 0 1 2 
R/R 3 2 4 
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Figure 12.23. Stabilized control chart for variables. 


largest or smallest values comes from the same feature it is an indication that the 
feature has changed. If the process is in statistical control for all features, the fea- 
ture responsible for the extreme values will vary randomly. 

When using stabilized charts it is possible to have a single control chart 
accompany a particular part or lot of parts through the entire production 
sequence. For example, the circuit boards described above could have a control 
chart that shows the results of process and product measurement for char- 
acteristics at all stages of production. The chart would then show the “proces- 
sing history” for the part or lot. The advantage would be a coherent log of the 
production of a given part. Table 12.15 illustrates a process control plan that 
could possibly use this approach. 

A caution is in order if the processing history approach is used. When small 
and short runs are common, the history of a given process can be lost among 
the charts of many different parts. This can be avoided by keeping a separate 
chart for each distinct process; additional paperwork is involved, but it might 
be worth the effort. If the additional paperwork burden becomes large, compu- 
terized solutions may be worth investigating. 


ATTRIBUTE SPC FOR SMALL AND SHORT RUNS 


When data are difficult to obtain, as is usual when small or short runs are 
involved, variables SPC should be used if at all possible. A variables 
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Table 12.15. PWB fab process capabilities and SPC plan. 


OPERATION FEATURE x R n 
Clean Bath pH 7 0.1 3/hr 
Rinse contamination 100 ppm 5 ppm 3/hr 
Cleanliness quality rating 78 4 3 pes/hr 
Laminate Riston thickness 1.5 min. 0.1mm 3 pes/hr 
Adhesion 7 in—lbs. 0.2 in.—lbs. 3 pes/hr 
Plating Bath lead % 10% 1% 3/hr 
Thickness 0.005" 0.0005" 3 pes/hr 
Resistance 0.12 0.000582 3 pes/hr 


measurement on a continuous scale contains more information than a dis- 
crete attributes classification provides. For example, a machine is cutting a 
piece of metal tubing to length. The specifications call for the length to be 
between 0.990" and 1.010" with the preferred length being 1.000" exactly. 
There are two methods available for checking the process. Method 7/1 
involves measuring the length of the tube with a micrometer and recording 
the result to the nearest 0.001". Method #2 involves placing the finished 
part into a “go/no-go gage.” With method #2 a part that is shorter than 
0.990" will go into the “no-go” portion of the gage, while a part that is 
longer than 1.010" will fail to go into the “go” portion of the gage. With 
method #1 we can determine the size of the part to within 0.001". With 
method #2 we can only determine the size of the part to within 0.020"; 
ie., either it is within the size tolerance, it’s too short, or it’s too long. If 
the process could hold a tolerance of less than 0.020", method #1 would 
provide the necessary information to hold the process to the variability it is 
capable of holding. Method #/2 would not detect a process drift until out 
of tolerance parts were actually produced. 
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Another way of looking at the two different methods is to consider each part 
as belonging to a distinct category, determined by the part’s length. Method 
F#1 allows any part that is within tolerance to be placed into one of twenty cate- 
gories. When out of tolerance parts are considered, method #1 is able to place 
parts into even more than twenty different categories. Method 7/1 also tells us 
if the part is in the best category, namely within +0.001" of 1.000"; if not, we 
know how far the part is from the best category. With method 742 we can 
place a given part into only three categories: too short, within tolerance, or too 
long. A part that is far too short will be placed in the same category as a part 
that is only slightly short. A part that is barely within tolerance will be placed 
in the same category as a part that is exactly 1.000" long. 


SPC OF ATTRIBUTES DATA FROM SHORT RUNS 


In spite of the disadvantages, it is sometimes necessary to use attributes data. 
Special methods must be used for attributes data used to control short run pro- 
cesses. We will describe two such methods: 

¢ Stabilized attribute control charts. 

¢ Demerit control charts. 


STABILIZED ATTRIBUTE CONTROL CHARTS 


When plotting attribute data statistics from short run processes two difficul- 
ties are typically encountered: 

1. Varying subgroup sizes. 

2. Asmall number of subgroups per production run. 

Item #1 results in messy charts with different control limits for each sub- 
group, distorted chart scales that mask significant variations, and chart patterns 
that are difficult to interpret because they are affected by both sample size 
changes and true process changes. Item #2 makes it difficult to track long-term 
process trends because the trends are broken up among many different control 
charts for individual parts. Because of these things, many people believe that 
SPC is not practical unless large and long runs are involved. This is not the 
case. In many cases stabilized attribute charts can be used to eliminate these 
problems. Although somewhat more complicated than classical control charts, 
stabilized attribute control charts offer a way of realizing the benefits of SPC 
with processes that are difficult to control any other way. 

Stabilized attribute charts may be used if a process is producing part features 
that are essentially the same from one part number to the next. Production lot 
sizes and sample sizes can vary without visibly affecting the chart. 
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Example one 

A lathe is being used to machine terminals of different sizes. Samples (of dif- 
ferent sizes) are taken periodically and inspected for burrs, nicks, tool marks, 
and other visual defects. 


Example two 

A printed circuit board hand assembly operation involves placing electrical 
components into a large number of different circuit boards. Although the 
boards differ markedly from one another, the hand assembly operation is 
similar for all of the different boards. 


Example three 

A job-shop welding operation produces small quantities of “one order only” 
items. However, the operation always involves joining parts of similar material 
and similar size. The process control statistic is weld imperfections per 100 
inches of weld. 

The techniques used to create stabilized attribute control charts are all based 
on corresponding classical attribute control chart methods. There are four 
basic types of control charts involved: 

1. Stabilized p charts for proportion of defective units per sample. 

2. Stabilized np charts for the number of defective units per sample. 

3. Stabilized c charts for the number of defects per unit. 

4. Stabilized u charts for the average number of defects per unit. 

All of these charts are based on the transformation 


sample statistic — process average 


A= 


12.41 
process standard deviation ( ) 


In other words, stabilized charts are plots of the number of standard devia- 
tions (plus or minus) between the sample statistic and the long-term process 
average. Since control limits are conventionally set at 3 standard deviations, 
stabilized control charts always have the lower control limit at —3 and the 
upper control limit at +3. Table 12.16 summarizes the control limit equations 
for stabilized control charts for attributes. 

When applied to long runs, stabilized attribute charts are used to compensate 
for varying sample sizes; process averages are assumed to be constant. 
However, stabilized attribute charts can be created even if the process average 
varies. This is often done when applying this technique to short runs of parts 
that vary a great deal in average quality. For example, a wave soldering process 
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Table 12.16. Stabilized attribute chart statistics. 


SAMPLE PROCESS 
ATTRIBUTE | CHART | STATISTIC | AVERAGE | PROCESS o Z 


VPC — p)/n | (p—p)/o 


SS 
aw 


Proportion of | pchart 


defective units 


Number of np chart np np Jnp(l —p) | (np —np)/o 


defective units 


Defects per unit | cchart c c Je (c—c)/o 
Average defects | uchart un u uln (u —u)/o 
per unit 


used for several missiles had boards that varied in complexity from less than 100 
solder joints to over 1,500 solder joints. Tables 12.17 and 12.18 show how the 
situation is handled to create a stabilized u chart. The unit size is 1,000 leads, 
set arbitrarily. It doesn’t matter what the unit size is set to, the calculations 
will still produce the correct result since the actual number of leads is divided 
by the unit size selected. w is the average number of defects per 1,000 leads. 


Example four 

From the process described in Table 12.17, 10 TOW missile boards of type E 
are sampled. Three defects were observed in the sample. Using Tables 12.16 
and 12.17 Z is computed for the subgroup as follows: 


o = V/u/n, we get wu = 2 from Table 12.17. 


50 x 10 
1,000 


o = /2/05= /4=2 


number of defects ts 


n = 0.5 units 


“= = 6 defects per unit 


number of units 0.5 
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Table 12.17. Data from a wave solder process. 


MISSILE BOARD LEADS UNITS/BOARD u 
Phoenix A 1,650 1.65 16 
B 800 0.80 9 

C 1,200 1.20 9 

TOW D 80 0.08 4 
E 50 0.05 2 

F 100 0.10 1 


Since Z is between —3 and +3 we conclude that the process has not gone out 
of control; ie., it is not being influenced by a special cause of variation. 

Table 12.18 shows the data for several samples from this process. The result- 
ing control chart is shown in Figure 12.24. Note that the control chart indicates 
that the process was better than average when it produced subgroups 2 and 3 
and perhaps 4. Negative Z values mean that the defect rate is below (better 
than) the long-term process average. Groups 7 and 8 show an apparent 
deterioration in the process with group 7 being out of control. Positive Z values 
indicate a defect rate above (worse than) the long-term process average. 

The ability to easily see process trends and changes like these in spite of 
changing part numbers and sample sizes is the big advantage of stabilized con- 
trol charts. The disadvantages of stabilized control charts are: 

1. They convert a number that is easy to understand, the number of defects 

or defectives, into a confusing statistic with no intuitive meaning. 

2. They involve tedious calculation. 

Item #1 can only be corrected by training and experience applying the tech- 
nique. Item 7/2 can be handled with computers; the calculations are simple to 
perform with a spreadsheet. Table 12.18 can be used as a guide to setting up the 
spreadsheet. Inexpensive handheld computers can be used to perform the calcu- 
lations right at the process, thus making the results available immediately. 
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Table 12.18. Stabilized u chart data for wave solder. 


NO. |BOARD | # |UNITS | ##SAMPLED | n o |DEFECTS | u Z 


B 9 0.80 1 0.80 | 3.35 7 8.75 | —0.07 


DEMERIT CONTROL CHARTS 


As described above, there are two kinds of data commonly used to perform 
SPC: variables data and attributes data. When short runs are involved we can 
seldom afford the information loss that results from using attribute data. 
However, the following are ways of extracting additional information from 
attribute data: 

1. Making the attribute data “less discrete” by adding more classification 

categories. 

2. Assigning weights to the categories to accentuate different levels of 

quality 

Consider a process that involves fabricating a substrate for a hybrid micro- 
circuit. The surface characteristics of the substrate are extremely important. 
The “ideal part” will have a smooth surface, completely free of any visible 
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Figure 12.24. Control chart of Z values from Table 12.18. 


flaws or blemishes. However, parts are sometimes produced with stains, pits, 
voids, cracks and other surface defects. Although undesirable, most of the less 
than ideal parts are still acceptable to the customer. 

If we were to apply conventional attribute SPC methods to this process the 
results would probably be disappointing. Since very few parts are actually 
rejected as unacceptable, a standard p chart or stabilized p chart would probably 
show a flat line at “zero defects” most of the time, even though the quality 
level might be less than the target ideal part. Variables SPC methods can’t be 
used because attributes data such as “stains” are not easily measured on a vari- 
ables scale. Demerit control charts offer an effective method of applying SPC 
in this situation. 

To use demerit control charts we must determine how many imperfections 
of each type are found in the parts. Weights are assigned to the different cat- 
egories. The quality score for a given sample is the sum of the weights times the 
frequencies of each category. Table 12.19 illustrates this approach for the sub- 
strate example. 

If the subgroup size is kept constant, the average for the demerit control chart 
is computed as follows (Burr, 1976), 


emeD = sum of subgroup demerits (12.42) 


number of subgroups 
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Table 12.19. Demerit scores for substrates. 


SUBGROUP NUMBER — | 1 


Attribute Weight | Freq. | Score 


Light stain 1 3 3 
Dark stain 5 5 1 5 
Small blister 1 2 1 1 
Medium blister 5 1 5 
Pit: 0.01—0.05 mm 1 3 3 


Pit: 0.06—0.10 mm 


Pit: larger than 0.10 mm 


TOTAL DEMERITS — 


Control limits are computed in two steps. First compute the weighted aver- 
age defect rate for each category. For example, there might be the following 
categories and weights 


CATEGORY WEIGHT 
Major 10 
Minor 5 
Incidental 1 


Three average defect rates, one each for major, minor, and incidental, could 
be computed using the following designations: 


¢c, = Average number of major defects per subgroup 
C, = Average number of minor defects per subgroup 
c; = Average number of incidental defects per subgroup 
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The corresponding weights might be W, = 10, W, = 5, W; = 1. Using this 
notation we compute the demerit standard deviation for this three category 
example as 


Op = We, + Wie, + W2e, (12.43) 


For the general case the standard deviation is 


(12.44) 

The control limits are 
LCL = D — 30p (12.45) 
UCL =D + 30p (12.46) 


If the Lower Control Limit is negative, it is set to zero. 


SIMPLIFIED QUALITY SCORE CHARTS 


The above procedure, while correct, may sometimes be too burdensome to 
implement effectively. When this is the case a simplified approach may be 
used. The simplified approach is summarized as follows: 

1. Classify each part in the subgroup into the following classes (weights are 


arbitrary). 
CLASS DESCRIPTION POINTS 
A Preferred quality. All product features at or very near 10 
targets. 
B Acceptable quality. Some product features have 5 


departed significantly from target quality levels, but 
they are a safe distance from the reject limits. 


C Marginal quality. One or more product features are in 1 
imminent danger of exceeding reject limits. 


D Reject quality. One or more product features fail to 0 


meet minimum acceptability requirements. 
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2. Plot the total scores for each subgroup, keeping the subgroup sizes 
constant. 

3. Treat the total scores as if they were variables data and prepare an indivi- 
duals and moving range control chart or an X and R chart. These charts 
are described in Pyzdek (1989) and in most texts on SPC. 


SUMMARY OF SHORT-RUN SPC 


Small runs and short runs are common in modern business environments. 
Different strategies are needed to deal with these situations. Advance planning 
is essential. Special variables techniques were introduced which compensate 
for small sample sizes and short runs by using special tables or mathematically 
transforming the statistics and charts. Attribute short run SPC methods were 
introduced that make process patterns more evident when small runs are 
produced. Demerit and scoring systems were introduced that extract more 
information from attribute data. 


EWMA 
EWMA charts 
SPC TECHNIQUES FOR AUTOMATED 
MANUFACTURING 


Many people erroneously believe that statistics are not needed when auto- 
mated manufacturing processes are involved. Since we have measurements 
from every unit produced, they reason, sampling methods are inappropriate. 
We will simply correct the process when the characteristic is not on target. 

This attitude reflects a fundamental misunderstanding of the relationship 
between a process and the output of a process. It also shows a lack of appreci- 
ation for the intrinsic variability of processes and of measurements. The fact is, 
even if you have a “complete” data record of every feature of every part pro- 
duced, you still have only a sample of the output of the process. The process is 
future-oriented in time, while the record of measurements is past-oriented. 
Unless statistical control is attained, you will be unable to use the data from 
past production to predict the variability from the process in the future (refer 
to the definition of control in page 321). And without statistical tools you have 
no sound basis for the belief that statistical control exists. 

Another reason process control should be based on an understanding and 
correct use of statistical methods is the effect of making changes without this 
understanding. Consider, for example, the following process adjustment rule: 
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Measure the diameter of the gear shaft. If the diameter is above the 
nominal size, adjust the process to reduce the diameter. If the diameter is 
below the nominal size, adjust the process to increase the diameter. 


The problem with this approach is described by Deming’s “funnel rules” (see 
above). This approach to process control will increase the variability of a statis- 
tically controlled process by 141%, certainly not what the process control ana- 
lyst had in mind. The root of the problem is a failure to realize that the part 
measurement is a sample from the process and, although it provides informa- 
tion about the state of the process, the information is incomplete. Only through 
using proper statistical methods can the information be extracted, analyzed 
and understood. 


PROBLEMS WITH TRADITIONAL SPC TECHNIQUES 


A fundamental assumption underlying traditional SPC techniques is that the 
observed values are independent of one another. Although the SPC tools are 
quite insensitive to moderate violations of this assumption (Wheeler, 1991), 
automated manufacturing processes often breach the assumption by enough 
to make traditional methods fail (Alwan and Roberts, 1989). By using scatter 
diagrams, as described in Chapter 14, you can determine if the assumption of 
independence is satisfied for your data. If not, you should consider using the 
methods described below instead of the traditional SPC methods. 

A common complaint about non-standard SPC methods is that they are 
usually more complex than the traditional methods (Wheeler, 1991). This is 
often true. However, when dealing with automated manufacturing processes 
the analysis is usually handled by a computer. Since the complexity of the analy- 
sis is totally invisible to the human operator, it makes little difference. Of 
course, if the operator will be required to act based on the results, he or she 
must understand how the results are to be used. The techniques described in 
this chapter which require human action are interpreted in much the same way 
as traditional SPC techniques. 


SPECIAL AND COMMON CAUSE CHARTS 


When using traditional SPC techniques the rules are always the same, 
namely 
1. As long as the variation in the statistic being plotted remains within the 
control limits, leave the process alone. 
2. Ifa plotted point exceeds a control limit, look for the cause. 
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This approach works fine as long as the process remains static. However, the 
means of many automated manufacturing processes often drift because of 
inherent process factors. In other words, the drift is produced by common 
causes. In spite of this, there may be known ways of intervening in the process 
to compensate for the drift. Traditionalists would say that the intervention 
should be taken in such a way that the control chart exhibits only random varia- 
tion. However, this may involve additional cost. Mindlessly applying arbitrary 
rules to achieve some abstract result, like a stable control chart, is poor practice. 
All of the options should be considered. 

One alternative is to allow the drift to continue until the cost of intervention 
equals the cost of running off-target. This alternative can be implemented 
through the use of a “common cause chart.” This approach, described in 
Alwan and Roberts (1989) and Abraham and Whitney (1990), involves creating 
a chart of the process mean. However, unlike traditional X charts, there are no 
control limits. Instead, action limits are placed on the chart. Action limits differ 
from control limits in two ways 

e They are computed based on costs rather than on statistical theory. 

e Since the chart shows variation from common causes, violating an action 
limit does not result in a search for a special cause. Instead, a prescribed 
action is taken to bring the process closer to the target value. 

These charts are called “common cause charts” because the changing level of 
the process is due to built-in process characteristics. The process mean is 
tracked by using exponentially weighted moving averages (EWMA). While 
somewhat more complicated than traditional X charts, EWMA charts have a 
number of advantages for automated manufacturing: 

e They can be used when processes have inherent drift. 

e EWMA charts provide a forecast of where the next process measurement 

will be. This allows feed-forward control. 

e EWMA models can be used to develop procedures for dynamic process 
control, as described later in this section. 


EWMA COMMON CAUSE CHARTS 


When dealing with a process that is essentially static, the predicted value of 
the average of every sample is simply the grand average. EWMA charts, on the 
other hand, use the actual process data to determine the predicted process 
value for processes that may be drifting. If the process has trend or cyclical com- 
ponents, the EWMA will reflect the effect of these components. Also, the 
EWMA chart produces a forecast of what the next sample mean will be; the 
traditional X chart merely shows what the process was doing at the time the 
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sample was taken. Thus, the EW MA chart can be used to take preemptive action 
to prevent a process from going too far from the target. 

If the process has inherent non-random components, an EWMA common 
cause chart should be used. This is an EWMA chart with economic action limits 
instead of control limits. EWMA control charts, which are described in the 
next section, can be used to monitor processes that vary within the action limits. 

The equation for computing the EWMA is 


EWMA = 9, + Ay, —5,) (12.47) 


In this equation y, is the predicted value of y at time period t, y, is the actual 
value at time period ¢, and / is a constant between 0 and 1. If / is close to 1, 
Equation 12.47 will give little weight to historic data; if 2 is close to 0 then 
current observations will be given little weight. EWMA can also be thought 
of as the forecasted process value at time period t +1, in other words, 
EWMA = Sigs 

Since most people already understand the traditional X chart, thinking 
about the relationship between X charts and EWMA charts can help you 
understand the EWMA chart. It is interesting to note that traditional X charts 
give 100% of the weight to the current sample and 0% to past data. This is 
roughly equivalent to setting 2 = 1 on an EWMA chart. In other words, the 
traditional X chart can be thought of as a special type of EWMA chart 
where past data are considered to be unimportant (assuming run tests are 
not applied to the Shewhart chart). This is equivalent to saying that the data 
points are all independent of one another. In contrast, the EWMA chart uses 
the information from all previous samples. Although Equation 12.47 may 
look as though it is only using the results of the most recent data point, in rea- 
lity the EWMA weighting scheme applies progressively less weight to each 
sample result as time passes. Figure 12.25 compares the weighting schemes of 
EWMA and X charts. 

In contrast, as A approaches 0 the EWMA chart begins to behave like a 
cusum chart. With a cusum chart all previous points are given equal weight. 
Between the two extremes the EWMA chart weights historical data in impor- 
tance somewhere between the traditional Shewhart chart and the cusum 
chart. By changing the value of 4 the chart’s behavior can be “adjusted” to 
the process being monitored. 

In addition to the weighting, there are other differences between the 
EWMA chart and the X chart. The “forecast” from the X chart is always the 
same: the next data point will be equal to the historical grand average. In 
other words, the X chart treats all data points as coming from a process that 
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Figure 12.25. Y versus EWMA weighting. 


doesn’t change its central tendency (implied when the forecast is always the 
grand average).* _ 

When using an Xchart it is not essential that the sampling interval be kept 
constant. After all, the process is supposed to behave as if it were static. 
However, the EWMA chart is designed to account for process drift and, there- 
fore, the sampling interval should be kept constant when using EWMA charts. 
This is usually not a problem with automated manufacturing. 


EXAMPLE 


Krishnamoorthi (1991) describes a mold line that produces green sand molds 
at the rate of about one per minute. The molds are used to pour cylinder blocks 
for large size engines. Application of SPC to the process revealed that the pro- 
cess had an assignable cause that could not be eliminated from the process. 
The mold sand, which was partly recycled, tended to increase and decrease in 


*We aren’t saying this situation actually exists, we are just saying that the X treats the process as if this were true. Studying the 
patterns of variation will often reveal clues to making the process more consistent, even if the process variation remains 


within the control limits. 
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temperature based on the size of the block being produced and the number of 
blocks in the order. Sand temperature is important because it affects the com- 
pactability percent, an important parameter. The sand temperature could not 
be better controlled without adding an automatic sand cooler, which was not 
deemed economical. However, the effect of the sand temperature on the com- 
pactability percent could be made negligible by modifying the amount of 
water added to the sand so feed-forward control was feasible. 

Although Krishnamoorthi doesn’t indicate that EWMA charts were used for 
this process, it is an excellent application for EWMA common cause charts. 
The level of the sand temperature doesn’t really matter, as long as it is known. 
The sand temperature tends to drift in cycles because the amount of heated 
sand depends on the size of the casting and how many are being produced. A tra- 
ditional control chart for the temperature would indicate that sand temperature 
is out-of-control, which we already know. What is really needed is a method to 
predict what the sand temperature will be the next time it is checked, then the 
operator can add the correct amount of water so the effect on the sand compact- 
ability percent can be minimized. This will produce an in-control control chart 
for compactability percent, which is what really matters. 

The data in Table 12.20 show the EWMA calculations for the sand temper- 
ature data. Using a spreadsheet program, Microsoft Excel for Windows, the 
optimal value of A, that is the value which provided the “best fit” in the sense 
that it produced the smallest sum of the squared errors, was found to be close 
to 0.9. Figure 12.26 shows the EWMA common cause chart for this data, and 
the raw temperature data as well. The EWMA is a forecast of what the sand tem- 
perature will be the next time it is checked. The operator can adjust the rate of 
water addition based on this forecast. 


EWMA CONTROL CHARTS 


Although it is not always necessary to put control limits on the EWMA chart, 
as shown by the above example, it is possible to do so when the situation calls 
for it. Three sigma control limits for the EWMA chart are computed based on 


2 2| A 
OEwMA = 0 Ins (12.48) 


For the sand temperature example above, 2 = 0.9 which gives 
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Table 12.20. Data for EWMA chart of sand temperature. 


SAND TEMPERATURE EWMA ERROR 
125 125.00* 0.00 
123 125.00 —2.00*” 
118 123.20*** —5.20 
116 118.52 —2.52 
108 116.25 —8.25 
112 108.83 3.17 
101 111.68 —10.68 
100 102.07 —2.07 

98 100.21 —2.21 
102 98.22 3.78 
111 101.62 9.38 
107 110.6 —3.06 
112 107.31 4.69 
112 111.53 0.47 
122 111.95 10.05 
140 121.00 19.00 
125 138.10 —13.10 
130 126.31 3.69 
136 129.63 6.37 
130 135.36 —5.36 


Continued on next page... 
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Table 12.20 (cont.) 

SAND TEMPERATURE EWMA ERROR 
112 130.54 —18.54 
115 113.85 1.15 
100 114.89 —14.89 
113 101.49 11.51 
111 111.85 —0.85 
128 111.08 16.92 
122 126.31 —4,31 
142 122.43 19.57 
134 140.64 —6.04 
130 134.60 —4.60 
131 130.46 0.54 
104 130.95 —26.95 

84 106.69 —22.69 
86 86.27 —0.27 
99 86.03 12.97 
90 97.70 —7.70 
91 90.77 0.23 
90 90.98 —0.98 
101 90.10 10.90 


* The starting EWMA is either the target, or, if there is no target, the first 
observation. 
Error = Actual observation— EWMA. E.g., —2 = 123 — 125. 
Other than the first sample, all EWMAs are computed as EWMA = last EWMA + 
Xx error. E.g., 123.2 =125 + 0.9 x (—2). 
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Figure 12.26. EWMA chart of sand temperature. 


o° is estimated using all of the data. For the sand temperature datao’ = 15.37 so 
o EWMA = 15.37 x ./0.82 = 13.92. The 30 control limits for the EWMA 
chart are placed at the grand average plus and minus 41.75. Figure 12.27 shows 
the control chart for these data. The EWMA line must remain within the con- 
trol limits. Since the EWMA accounts for “normal drift” in the process center 
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Figure 12.27. EWMA control chart of sand temperature. 
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line, deviations beyond the control limits imply assignable causes other than 
those accounted for by normal drift. Again, since the effects of changes in tem- 
perature can be ameliorated by adjusting the rate of water input, the EWMA 
control chart may not be necessary. 


CHOOSING THE VALUE OF 4 


The choice of J is the subject of much literature. A value A of near 0 provides 
more “smoothing” by giving greater weight to historic data, while a 1 value 
near 1 gives greater weight to current data. Most authors recommend a value in 
the range of 0.2 to 0.3. The justification for this range of 2 values is probably 
based on applications of the EWMA technique in the field of economics, 
where EWMA methods are in widespread use. Industrial applications are less 
common, although the use of EWMA techniques is growing rapidly. 

Hunter (1989) proposes a EWMA control chart scheme where 2 = 0.4. This 
value of A provides a control chart with approximately the same statistical prop- 
erties as a traditional X chart combined with the run tests described in the 
ATET Statistical Quality Control Handbook (commonly called the Western 
Electric Rules). It also has the advantage of providing control limits that are 
exactly half as wide as the control limits on a traditional X chart. Thus, to com- 
pute the control limits for an EWMA chart when / is 0.4 you simply compute 
the traditional X chart (or X chart) control limits and divide the distance 
between the upper and lower control limits by two. The EWMA should remain 
within these limits. 

As mentioned above, the optimal value of 4 can be found using some spread- 
sheet programs. The sum of the squared errors is minimized by changing the 
value of 2. If your spreadsheet doesn’t automatically find the minimum, it can 
be approximated manually by changing the cell containing A or by setting up a 
range of A values and watching what happens to the cell containing the sum of 
the squared errors. A graph of the error sum of the squares versus different 1 
values can indicate where the optimum A lies. 


MINITAB EWMA EXAMPLE 

Minitab has a built-in EWMA analysis capability. We will repeat our analysis 
for the sand temperature data. Choose Stat > Control Charts > EWMA and 
you will see a dialog box similar to the one shown in Figure 12.28. Entering the 
weight of 0.9 and a subgroup size of 1, then clicking OK, produces the chart in 
Figure 12.29. 

You may notice that the control limits calculated with Minitab are different 
than those calculated in the previous example. The reason is that Minitab’s esti- 


0 10 20 30 


Sample Number 


Figure 12.29. Minitab EWMA chart. 
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mate of sigma is based on the average moving range. This method gives a sigma 
value of 7.185517, substantially less than the estimate of 15.37 obtained by sim- 
ply calculating sigma combining all of the data. Minitab’s approach removes 
the effect of the process drift. Whether or not this effect should be removed 
from the estimate of sigma is an interesting question. In most situations we 
probably want to remove it so our control chart will be more sensitive, allowing 
us to detect more special causes for removal. However, as this example illus- 
trates, the situation isn’t always clear cut. In the situation described by the exam- 
ple we might actually want to include the variation from drift into the control 
limit calculations to prevent operator tampering. 


EWMA CONTROL CHARTS VERSUS INDIVIDUALS 
CHARTS 


In many cases an individuals control chart (I chart) will give results compar- 
able to the EWMA control chart. When this is the case it is usually best to opt 
for the simpler I chart. An I chart is shown in Figure 12.30 for comparison with 
the EWMA chart. The results are very similar to the EWMA chart from 
Minitab. 
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Figure 12.30. I chart for sand temperature. 
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SPECIAL CAUSE CHARTS 


Whether using a EWMA common cause chart without control limits or an 
EWMA control chart, it is a good idea to keep track of the forecast errors 
using a control chart. The special cause chart is a traditional X chart, created 
using the difference between the EWMA forecast and the actual observed 
values. Figure 12.31 shows the special cause chart of the sand temperature data 
analyzed above. The chart indicates good statistical control. 
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Figure 12.31. Special cause control chart of EWMA errors. 


SPC and automatic process control 


As SPC has grown in popularity its use has been mandated with more and 
more processes. When this trend reached automated manufacturing processes 
there was resistance from process control analysts who were applying a dif- 
ferent approach with considerable success (Palm, 1990). Advocates of SPC 
attempted to force the use of traditional SPC techniques as feedback mecha- 
nisms for process control. This inappropriate application of SPC was correctly 
denounced by process control analysts. SPC is designed to serve a purpose 
fundamentally different than automatic process control (APC). SPC advocates 
correctly pointed out that APC was not a cure-all and that many process con- 
trollers added variation by making adjustments based on data analysis that was 
statistically invalid. 
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Both SPC and APC have their rightful place in Six Sigma. APC attempts to 
dynamically control a process to minimize variation around a target value. 
This requires valid statistical analysis, which is the domain of the statistical 
sciences. SPC makes a distinction between special causes and common causes 
of variation. If APC responds to all variation as if it were the same it will result 
in missed opportunities to reduce variation by attacking it at the source. A pro- 
cess that operates closer to the target without correction will produce less varia- 
tion overall than a process that is frequently returned to the target via APC. 
However, at times APC must respond to common cause variation that can’t be 
economically eliminated, e.g., the mold process described above. Properly used, 
APC can greatly reduce variability in the output. 

Hunter (1986) shows that there is a statistical equivalent to the PID control 
equation commonly used. The PID equation is 


u(t) = Ke(t) + =I e(s)ds + KTp (+) (12.49) 


The “PID” label comes from the fact that the first term is a proportional 
term, the second an integral term and the third a derivative term. Hunter modi- 
fied the basic EWMA equation by adding two additional terms. The result is 
the empirical control equation. 


Vor = +e, +4. oe, + 4,Ve, (12.50) 


The term Ve, means the first difference of the errors e, i.e.. Ve, =e, — e,_1. 
Like the PID equation, the empirical control equation has a proportional, an 
integral and a differential term. It can be used by APC or the results can be 
plotted on a common cause chart and reacted to by human operators, as 
described above. A special cause chart can be created to track the errors in the 
forecast from the empirical control equation. Such an approach may help to 
bring SPC and APC together to work on process improvement. 
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Process Capability Analysis 


PROCESS CAPABILITY ANALYSIS (PCA) 
Process capability analysis is a two-stage process that involves: 
1. Bringing a process into a state of statistical control for a reasonable 


period of time. 
2. Comparing the long-term process performance to management or engi- 


neering requirements. 
Process capability analysis can be done with either attribute data or contin- 


uous data ifand only if the process is in statistical control, and has been for a rea- 


sonable period of time (Figure 13.1).* 
Application of process capability methods to processes that are not in sta- 
tistical control results in unreliable estimates of process capability and should 


never be done. 


How to perform a process capability study 


This section presents a step-by-step approach to process capability analysis 


(Pyzdek, 1985). 


*Occasional freak values from known causes can usually be ignored. 


Copyright 2003 by The McGraw-Hill Companies, Inc. Click Here for Terms of Use. 
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VARIATION: COMMON AND SPECIAL CAUSES 
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Figure 13.1. Process control concepts illustrated. 


From Continuing Process Control and Process Capability Improvement, p. 4a. Copyright 1983. 


Used by permission of the publisher, Ford Motor Company, Dearborn, Michigan. 


1. Select a candidate for the study 
This step should be institutionalized. A goal of any organization should 
be ongoing process improvement. However, because a company has 
only a limited resource base and can’t solve all problems simultaneous- 
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ly, it must set priorities for its efforts. The tools for this include Pareto 
analysis and fishbone diagrams. 

Define the process 

It is all too easy to slip into the trap of solving the wrong 
problem. Once the candidate area has been selected in step 1, 
define the scope of the study. A process is a unique combination 
of machines, tools, methods, and personnel engaged in adding 
value by providing a product or service. Each element of the 
process should be identified at this stage. This is not a trivial exer- 
cise. The input of many people may be required. There are likely 
to be a number of conflicting opinions about what the process 
actually involves. 

Procure resources for the study 

Process capability studies disrupt normal operations and require 
significant expenditures of both material and human resources. 
Since it is a project of major importance, it should be managed as 
such. All of the usual project management techniques should be 
brought to bear. This includes planning, scheduling, and management 
status reporting. 

Evaluate the measurement system 

Using the techniques described in Chapter 9, evaluate the measure- 
ment system’s ability to do the job. Again, be prepared to spend the 
time necessary to get a valid means of measuring the process before 
going ahead. 

Prepare a control plan 

The purpose of the control plan is twofold: 1) isolate and control as 
many important variables as possible and, 2) provide a mechanism for 
tracking variables that cannot be completely controlled. The object of 
the capability analysis is to determine what the process can do if it is 
operated the way it is designed to be operated. This means that such 
obvious sources of potential variation as operators and vendors will be 
controlled while the study is conducted. In other words, a single well- 
trained operator will be used and the material will be from a single 
vendor. 

There are usually some variables that are important, but that are not 
controllable. One example is the ambient environment, such as tem- 
perature, barometric pressure, or humidity. Certain process variables 
may degrade as part of the normal operation; for example, tools wear 
and chemicals are used. These variables should still be tracked using 
logsheets and similar tools. See page 74, Information systems require- 
ments. 
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10. 


Select a method for the analysis 

The SPC method will depend on the decisions made up to this point. If 
the performance measure is an attribute, one of the attribute charts 
will be used. Variables charts will be used for process performance mea- 
sures assessed on a continuous scale. Also considered will be the skill 
level of the personnel involved, need for sensitivity, and other resources 
required to collect, record, and analyze the data. 

Gather and analyze the data 

Use one of the control charts described in Chapter 12, plus common 
sense. It is usually advisable to have at least two people go over the 
data analysis to catch inadvertent errors in entering data or performing 
the analysis. 

Track down and remove special causes 

A special cause of variation may be obvious, or it may take months of 
investigation to find it. The effect of the special cause may be good or 
bad. Removing a special cause that has a bad effect usually involves 
eliminating the cause itself. For example, if poorly trained operators 
are causing variability the special cause is the training system (not the 
operator) and it is eliminated by developing an improved training sys- 
tem or a process that requires less training. However, the “removal” 
of a beneficial special cause may actually involve incorporating the spe- 
cial cause into the normal operating procedure. For example, if it is dis- 
covered that materials with a particular chemistry produce better 
product the special cause is the newly discovered material and it can 
be made a common cause simply by changing the specification to assure 
that the new chemistry is always used. 

Estimate the process capability 

One point cannot be overemphasized: the process capability cannot be 
estimated until a state of statistical control has been achieved! After 
this stage has been reached, the methods described later in this chapter 
may be used. After the numerical estimate of process capability has 
been arrived at, it must be compared to management’s goals for the pro- 
cess, or it can be used as an input into economic models. Deming’s all- 
or-none rules (Deming 1986, 409ff) provide a simple model that can be 
used to determine if the output from a process should be sorted 100% 
or shipped as-is. 

Establish a plan for continuous process improvement 

Once a stable process state has been attained, steps should be taken to 
maintain it and improve upon it. SPC is just one means of doing this. 
Far more important than the particular approach taken is a company 
environment that makes continuous improvement a normal part of 
the daily routine of everyone. 
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Statistical analysis of process capability data 


This section presents several methods of analyzing the data obtained from a 
process capability study. 


CONTROL CHART METHOD: ATTRIBUTES DATA 


1. Collect samples from 25 or more subgroups of consecutively produced 
units. Follow the guidelines presented in steps 1-10 above. 

2. Plot the results on the appropriate control chart (e.g. c chart). If all 
groups are in statistical control, go to the step #3. Otherwise identify 
the special cause of variation and take action to eliminate it. Note that a 
special cause might be beneficial. Beneficial activities can be “elimi- 
nated” as special causes by doing them all of the time. A special cause is 
“special” only because it comes and goes, not because its impact is either 
good or bad. 

3. Using the control limits from the previous step (called operation control 
limits), put the control chart to use for a period of time. Once you are 
satished that sufficient time has passed for most special causes to have 
been identified and eliminated, as verified by the control charts, go to 
the step #4. 

4. The process capability is estimated as the control chart centerline. The 
centerline on attribute charts is the long-term expected quality level 
of the process, e.g., the average proportion defective. This is the level 
created by the common causes of variation. 

If the process capability doesn’t meet management requirements, take 
immediate action to modify the process for the better. “Problem solving” (e.g., 
studying each defective) won’t help, and it may result in tampering. Whether it 
meets requirements or not, always be on the lookout for possible process 
improvements. The control charts will provide verification of improvement. 


CONTROL CHART METHOD: VARIABLES DATA 


1. Collect samples from 25 or more subgroups of consecutively produced 
units, following the 10-step plan described above. : 

2. Plot the results on the appropriate control chart (e.g., X and R chart). If 
all groups are in statistical control, go to the step #3. Otherwise identify 
the special cause of variation and take action to eliminate it. 

3. Using the control limits from the previous step (called operation control 
limits), put the control chart to use for a period of time. Once you are 
satished that sufficient time has passed for most special causes to have 
been identified and eliminated, as verified by the control charts, estimate 
process capability as described below. 
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The process capability is estimated from the process average and standard 
deviation, where the standard deviation is computed based on the average 
range or average standard deviation. When statistical control has been achieved, 
the capability is the level created by the common causes of process variation. 
The formulas for estimating the process standard deviation are: 


R chart method: 
4 aR 
ae 13.1 
a=7 (13.1 
S chart method: 
Ga (13.2) 
C4 


The values d, and c, are constants from Table 11 in the Appendix. 


Process capability indexes 


Only now can the process be compared to engineering requirements.* One 
way of doing this is by calculating “Capability Indexes.” Several popular capa- 
bility indexes are given in Table 13.1. 


Table 13.1. Process capability indices. 


engineering tolerance 
ease 6 (13.3) 
60 
6a 
Cp, = 100 x ——_— (13.4) 
engineering tolerance 
engineering tolerance 
Cy = 8G (13.5) 
upper specification — X 
p fee elisa - (13.6) 
X-1 ificati 
z, = ower spect ication (13.7) 


Continued on next page... 


*Other sources of requirements include customers and management. 
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Table 13.1—Continued . .. 


ZMIN. = Minimum {Z,, Zy} (13.8) 
Z. 
Cox = = (13.9) 
Cp 
Com = —— 2 (13.10) 
(4—T) 
ga 


Interpreting capability indexes 

Perhaps the biggest drawback of using process capability indexes is that they 
take the analysis a step away from the data. The danger is that the analyst will 
lose sight of the purpose of the capability analysis, which is to improve quality. 
To the extent that capability indexes help accomplish this goal, they are worth- 
while. To the extent that they distract from the goal, they are harmful. The 
analyst should continually refer to this principle when interpreting capability 
indexes. 

Cp—This is one of the first capability indexes used. The “natural tolerance” 
of the process is computed as 60. The index simply makes a direct com- 
parison of the process natural tolerance to the engineering require- 
ments. Assuming the process distribution is normal and the process 
average is exactly centered between the engineering requirements, a 
Cp index of 1 would give a “capable process.” However, to allow a bit 
of room for process drift, the generally accepted minimum value for 
Cp is 1.33. In general, the larger Cp is, the better. For a Six Sigma pro- 
cess, i.e., a process that produces 3.4 defects per million opportunities 
including a 1.5 sigma shift, the value of Cp would be 2. 

The Cp index has two major shortcomings. First, it can’t be used 
unless there are both upper and lower specifications. Second, it does 
not account for process centering. If the process average is not exactly 
centered relative to the engineering requirements, the Cp index will 
give misleading results. In recent years, the Cp index has largely been 
replaced by Cpx (see below). 
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Cr—The Cp index is equivalent to the Cp index. The index simply makes a 
direct comparison of the process to the engineering requirements. 
Assuming the process distribution is normal and the process average 
is exactly centered between the engineering requirements, a Cp index 
of 100% would give a “capable process.” However, to allow a bit of 
room for process drift, the generally accepted maximum value for Cr 
is 75%. In general, the smaller Cp is, the better. The Cg index suffers 
from the same shortcomings as the Cp index. For a Six Sigma process, 
ie., a process that produces 3.4 defects per million opportunities includ- 
ing a 1.5 sigma shift, the value of Cg would be 50%. 

Cy—The Cy index is generally used to evaluate machine capability studies, 
rather than full-blown process capability studies. Since variation will 
increase when other sources of process variation are added (e.g., tool- 
ing, fixtures, materials, etc.), Cy uses an 8 sigma spread rather than a 6 
sigma spread to represent the natural tolerance of the process. For a 
machine to be used on a Six Sigma process, a 10 sigma spread would 
be used. 

Zy—The Zy index measures the process location (central tendency) relative 
to its standard deviation and the upper requirement. If the distribution 
is normal, the value of Zy can be used to determine the percentage 
above the upper requirement by using Table 2 in the Appendix. The 
method is the same as described in Equations 9.11 and 9.12, using the 
Z statistic, simply use Zy instead of using Z. 

In general, the bigger Zy is, the better. A value of at least +3 is 
required to assure that 0.1% or less defective will be produced. A value 
of +4 is generally desired to allow some room for process drift. For a 
Six Sigma process Zy would be +6. 

Zi—The Z, index measures the process location relative to its standard 
deviation and the lower requirement. If the distribution is normal, the 
value of Z, can be used to determine the percentage below the lower 
requirement by using Table 2 in the Appendix. The method is the 
same as described in Equations 9.11 and 9.12, using the Z transforma- 
tion, except that you use —Z, instead of using Z. 

In general, the bigger Z, is, the better. A value of at least +3 is 
required to assure that 0.1% or less defective will be produced. A value 
of +4 is generally desired to allow some room for process drift. For a 
Six Sigma process Z; would be +6. 

Zmin— Lhe value of Zn is simply the smaller of the Z; or the Zy values. It is 
used in computing Cpx. For a Six Sigma process Zin would be +6. 

Cpx—The value of Cpx is simply Zyrn divided by 3. Since the smallest value 

represents the nearest specification, the value of Cpx tells you if the pro- 
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cess is truly capable of meeting requirements. A Cpx of at least +1 is 
required, and +1.33 is preferred. Note that Cpx is closely related to Cp, 
the difference between Cpx and Cp represents the potential gain to be 
had from centering the process. For a Six Sigma process Cpx would be 2. 


Example of capability analysis using normally 
distributed variables data 


Assume we have conducted a capability analysis using X-bar and R charts 
with subgroups of 5. Also assume that we found the process to be in statistical 
control with a grand average of 0.99832 and an average range of 0.02205. From 
the table of d, values (Appendix Table 11), we find d) is 2.326 for subgroups of 
5. Thus, using Equation 13.1, 


0.02205 
2.326 


= 0.00948 


= 


Before we can analyze process capability, we must know the requirements. 
For this process the requirements are a lower specification of 0.980 and an 
upper specification of 1.020 (1.000 + 0.020). With this information, plus the 
knowledge that the process performance has been in statistical control, we can 
compute the capability indexes for this process. 


__ engineering tolerance _ 1.020 — 0.9800 


Cp= a = = 0.703 
60 6 X 0.00948 
60 6 X 0.00948 
Cp = 100 x ———— = 100 x ———__— = 142.2% 
engineering tolerance 0.04 
engineering tolerance 0.04 
Cre 2: = = 0.527 
80 8 x 0.00948 
7 — upper specification — X a hb020 = 0.99832 
a G ~~ 0.00948 
X — lower specification 0.99832 — 0.980 
Li = me = = 1.9 


oO 0.00948 
Z MIN = Minimum {1.9, 2.3} = 1.9 
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Assuming that the target is precisely 1.000, we compute 


0.703 


C, 
Com — = 5 
5 2 0.99832 — 1.000 
pa a 2 
62 0.00948 


= 0.692 


DISCUSSION 


Cp—(0.703) Since the minimum acceptable value for this index is 1, the 0.703 
result indicates that this process cannot meet the requirements. 
Furthermore, since the Cp index doesn’t consider the centering pro- 
cess, we know that the process can’t be made acceptable by merely 
adjusting the process closer to the center of the requirements. Thus, 
we can expect the Z;, Zy, and Zyqqn values to be unacceptable too. 

Cr—(142.2%) This value always gives the same conclusions as the Cp index. 
The number itself means that the “natural tolerance” of the process 
uses 142.2% of the engineering requirement, which is, of course, unac- 
ceptable. 

Cyr—(0.527) The Cyy index should be 1.33 or greater. Obviously it is not. If 
this were a machine capability study the value of the Cy, index would 
indicate that the machine was incapable of meeting the requirement. 

Zu—(+2.3) We desire a Zy of at least +3, so this value is unacceptable. We 
can use Zz to estimate the percentage of production that will exceed 
the upper specification. Referring to Table 2 in the Appendix we find 
that approximately 1.1% will be oversized. 

Zi, —(+1.9) We desire a Z; of at least +3, so this value is unacceptable. We can 
use Z; to estimate the percentage of production that will be below the 
lower specification. Referring to Table 2 in the Appendix we find that 
approximately 2.9% will be undersized. Adding this to the 1.1% over- 
sized and we estimate a total reject rate of 4.0%. By subtracting this 
from 100% we get the projected yield of 96.0%. 

ZMiN—(+1.9) The smaller of Z; and Zy. Since neither of these two results 
were acceptable, Zyyn cannot be acceptable. 

Cpx—(0.63) The value of Cpx is only slightly smaller than that of Cp. This 
indicates that we will not gain much by centering the process. The 
actual amount we would gain can be calculated by assuming the process 
is exactly centered at 1.000 and recalculating Zyn, This gives a pre- 
dicted total reject rate of 3.6% instead of 4.0%. 
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EXAMPLE OF NORMAL CAPABILITY ANALYSIS 
USING MINITAB 


Minitab has a built-in capability analysis feature, which will be demonstrated 
here using the rod diameter data. The output is shown in Figure 13.2. The sum- 
mary, which is called a “Six Pack” in Minitab, provides a compact picture of 
the most important statistics and analysis. The control charts tell you if the pro- 
cess is in statistical control (it is). If it’s out of control, stop and find out why. 
The histogram and normal probability plot tell you if the normality assumption 
is justified. If not, you can’t trust the capability indices. Consider using 
Minitab’s non-normal capability analysis (see “Example of non-normal capabil- 
ity analysis using Minitab” below). The “within” capability indices are based 
on within-subgroup variation only, called short-term variability. The C, and 
C,, values are both unacceptable. The “overall” capability indices are based on 
total variation, called long-term variability. Total variation includes variation 
within subgroups and variation between subgroups. The P,, and P,,;, values are 
both unacceptable. The Capability Plot in the lower right of the six pack graphi- 
cally compares within variability (short-term) and overall variability (long- 
term) to the specifications. Ideally, for a Six Sigma process, the process variabil- 
ity (Process Tolerance) will be about half of the specifications. However, the 


Capability SixPack for Rod Diameter Data 
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Figure 13.2. Minitab capability analysis for normally distributed data. 
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capability plot for the example shows that the process tolerance is actually 
wider than the specifications. 

What is missing in the six pack is an estimate of the process yield. There is an 
option in the six pack to have this information (and a great deal more) stored 
in the worksheet. Alternatively, you can run Minitab’s Capability Analysis 
(Normal) procedure and get the information along with a larger histogram 
(see Figure 13.3). The PPM levels confirm what the capability and performance 
indices told us, this process just ain’t up to snuff! 


Capability Analysis for Normally Distributed Data 


LSL Target USL 
Process Data 

USL 1.02000 I Within 
Target 1.00000 op CaS 
LSL 0.98000 I & 1 PS I Overall 
Mean 0.99895 | 
Sample N 125 | | 
StDev (Within) 0.0098806 
StDev (Overall) 0.0101939 | | 

| | 

I I 
Potential (Within) Capability 
Cp 0.67 | | 
CPU 071 
CPL 0.64 = - 

| | | 
Cpk 0.64 
Cpm 0.65 0.96 0.97 0.98 0.99 1.00 1.01 1.02 1.03 

Overall Capability Observed Performance Exp. "Within" Performance Exp. "Overall" Performance 

Pp 0.65 PPM <LSL 48000.00 PPM <LSL 27569.59 PPM <LSL 31525.09 
PPU 0.69 PPM > USL 16000.00 PPM > USL 16561.99 PPM > USL 19456.92 
PPL 0.62 PPM Total 64000.00 PPM Total 44131.57 PPM Total 50982.02 
Ppk 0.62 


Figure 13.3. An alternative Minitab capability analysis. 


EXAMPLE OF NON-NORMAL CAPABILITY ANALYSIS 
USING MINITAB 


Minitab has a built-in capability to perform process capability analysis for 
non-normal data which will be demonstrated with an example. The process 
involved is technical support by telephone. A call center has recorded the total 
time it takes to “handle” 500 technical support calls. Handle time is a total 
cycle time metric which includes gathering preliminary information, addressing 
the customer’s issues, and after call work. It isa CTQ metric that also impacts 
the shareholder. It has been determined that the upper limit on handle time is 
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45 minutes. We assume that the instructions specified in the “how to perform a 
“|: bP) 

process capability study” approach have been followed and that we have com- 

pleted the first six steps and have gathered the data. We are, therefore, at the 

“analyze the data” step. 


Phase 1—Check for special causes 

To begin we must determine if special causes of variation were present during 
our study. A special cause is operationally defined as points beyond one of the 
control limits. Some authors recommend that individuals control charts be 
used for all analysis, so we'll try this first, see Figure 13.4. 
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Figure 13.4. Individuals process behavior chart for handle time. 


There are 12 out-of-control points in the chart shown in Figure 13.4, indicat- 
ing that special causes are present. However, a closer look will show that there’s 
something odd about the chart. Note that the lower control limit (LCL) is 
—18.32. Since we are talking about handle time, it is impossible to obtain any 
result that is less than zero. A reasonable process owner might argue that if the 
LCL is in the wrong place (which it obviously is), then the upper control limit 
(UCL) may be as well. Also, the data appear to be strangely cut-off near the bot- 
tom. Apparently the individuals chart is not the best way to analyze data like 
these. 
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But what can be done? Since we don’t know if special causes were present, we 
can’t determine the proper distribution for the data. Likewise, if we don’t 
know the distribution of the data we can’t determine if special causes are present 
because the control limits may be in the wrong place. This may seem to be a clas- 
sic case of “which came first, the chicken or the egg?” Fortunately there is a 
way out. The central limit theorem tells us that stable distributions produce nor- 
mally distributed averages, even when the individuals data are not normally dis- 
tributed. Since “stable” means no special causes, then a process with non- 
normal averages would be one that is influenced by special causes, which is pre- 
cisely what we are looking for. We created subgroups of 10 in Minitab (i.e., 
observations 1-10 are in subgroup 1, observations 11-20 are in subgroup 2, 
etc.) and tested the normality of the averages. The probability plot in Figure 
13.5 indicates that the averages are normally distributed. 


Normality Test for Averages 
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N: 50 P-Value: 0.856 


Figure 13.5. Normality test of subgroups of 2 = 10. 


Figure 13.6 shows the control chart for the process using averages instead of 
individuals. The chart indicates that the process is in statistical control. The pro- 
cess average is stable at 18.79 minutes. The LCL is comfortably above zero at 
5.9 minutes; any average below this is an indication that things are better than 
normal and we’d want to know why in case we can do it all of the time. Any aver- 
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Figure 13.6. Averages of handle time (7 = 10 per subgroup). 


age above 31.67 minutes indicates worse than normal behavior and we’d like to 
find the reason and fix it. Averages between these two limits are normal for 
this process. 


Phase 2—Examine the distribution 

Now that stability has been determined, we can trust the histogram to give us 
an accurate display of the distribution of handle times. The histogram shows 
the distribution of actual handle times, which we can compare to the upper spe- 
cification limit of 45 minutes. The couldn’t be done with the control chart in 
Figure 13.6 because it shows averages, not individual times. Figure 13.7 shows 
the histogram of handle time with the management upper requirement of 45 
minutes drawn in. Obviously a lot of calls exceed the 45 minute requirement. 
Since the control chart is stable, we know that this is what we can expect from 
this process. There is no point in asking why a particular call took longer than 
45 minutes. The answer is “It’s normal for this process.” If management doesn’t 
like the answer they'll need to sponsor one or more Six Sigma projects to 
improve the process. 
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Figure 13.7. Histogram of handle time. 


Phase 3—Predicting the long-term defect rate for the process 

The histogram makes it visually clear that the process distribution is non- 
normal. This conclusion can be tested statistically with Minitab by going to 
Stats > Basic Statistics > Normality test. Minitab presents the data in a chart 
specially scaled so that normally distributed data will plot as a straight line 
(Figure 13.8). The vertical axis is scaled in cumulative probability and the hori- 
zontal in actual measurement values. The plot shows that the data are not even 
close to falling on the straight line, and the P-value of 0 confirms that the data 
are not normal.* 

To make a prediction about the defect rate we need to find a distribution that 
fits the data reasonably well. Minitab offers an option that performs capability 
analysis using the Weibull rather than the normal distribution. Choose Stat > 
Quality Tools > Capability Analysis (Weibull) and enter the column name for 
the handle time data. The output is shown in Figure 13.9. 

Minitab calculates process performance indices rather than process capabil- 
ity indices (ie, Pi. instead of Cai). This means that the denominator for the 


*The null hypothesis is that the data are normally distributed. The P-value is the probability of obtaining the observed results 


if the null hypothesis were true. In this case, the probability is 0. 
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Figure 13.8. Normality test of handle time. 
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Figure 13.9. Capability analysis of handle times based on the Weibull distribution. 
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indices is the overall standard deviation rather than the standard deviation 
based on only within-subgroup variability. This is called the long-term process 
capability, which Minitab labels as “Overall (LT) Capability.” When the 
process is in statistical control, as this one is, there will be little difference in 
the estimates of the standard deviation. When the process is not in statistical 
control the short-term capability estimates have no meaning, and the long- 
term estimates are of dubious value as well. Process performance indices are 
interpreted in exactly the same way as their process capability counterparts. 
Minitab’s analysis indicates that the process is not capable (P,1, < 1). The 
estimated long-term performance of the process is 41,422 defects per million 
calls. The observed performance is even worse, 56,000 defects per million 
calls. The difference is a reflection of lack of fit. The part of the Weibull 
curve we're most interested in is the tail area above 45, and the curve appears 
to drop off more quickly than the actual data. When this is the case it is better 
to estimate the long-term performance using the actual defect count rather 
than Minitab’s estimates. 


ESTIMATING PROCESS YIELD 


Rolled throughput yield and sigma level 


The rolled throughput yield (RTY) summarizes defects-per-million- 
opportunities (DPMO) data for a process or product. DPMO is the same as 
the parts-per-million calculated by Minitab. RTY is a measure of the overall 
process quality level or, as its name suggests, throughput. For a process, 
throughput is a measure of what comes out of a process as a function of 
what goes into it. For a product, throughput is a measure of the quality of 
the entire product as a function of the quality of its various features. 
Throughput combines the results of the capability analyses into a measure of 
overall performance. 

To compute the rolled throughput yield for an N-step process (or N-charac- 
teristic product), use the following equation: 


Rolled Throughput Yield 
, __ DPMO, , _ DPMO; , _ DPMOn (13.11) 
= — — —_]} x — ——_—__—_ ]... — 
1,000,000 1,000,000 1,000,000 


Where DPMO,, is the defects-per-million-opportunities for step x in the pro- 
cess. For example, consider a 4-step process with the following DPMO levels 
at each step (Table 13.2) (dpu is defects-per-unit). 
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Table 13.2. Calculations used to find RTY. 


PROCESS STEP DPMO dpu=DPMO/1,000,000 1—dpu 
1 5,000 0.005000 0.9950 
2 15,000 0.015000 0.9850 
3 1,000 0.001000 0.9990 
4 50 0.000050 0.99995 


Rolled Throughput Yield = 0.995 x 0.985 x 0.999 x 0.99995 = 0.979 


Figure 13.10 shows the Excel spreadsheet and formula for this example. The 
meaning of the RTY is simple: if you started 1,000 units through this 4-step pro- 
cess you would only get 979 units out the other end. Or, equivalently, to get 
1,000 units out of this process you should start with (1,000/0.979) + 1 = 1,022 
units of input. Note that the RTY is worse than the worst yield of any process 
or step. It is also worse than the average yield of 0.995. Many a process owner is 
lulled into complacency by reports showing high average process yields. They 
are confused by the fact that, despite high average yields, their ratio of end-of- 
the-line output to starting input is abysmal. Calculating RTY may help open 
their eyes to what is really going on. The effect of declining RTYs grows expo- 
nentially as more process steps are involved. 


7 a RTY equation 
Gisele Cc D 
Process DPMO-  DPMO/1.0 |- 
5 Step 00.000 at 00 
6 | 5.000 0.005 0.995 
7 2 15,000 0.015 0.985 
8 1.000 0.001 0.999 
9 4 50 0,00005 0.99995 
10 
11 RTY 0.979046 


Figure 13.10. Excel spreadsheet for RTY. 
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The sigma level equivalent for this 4-step process RTY is 3.5 (see Appendix, 
Table 18). This would be the estimated “process” sigma level. Also see 
“Normalized yield and sigma level” below. Use the RTY worksheet below to 
document the RTY. 


USING e“?" TO CALCULATE RTY 


In Chapter 9 we discussed that, if a Poisson distribution is assumed for 
defects, then the probability of getting exactly x defects on a unit from a process 
with an average defect rate of jz is P(x) = (u*e “)/x!, where e = 2.71828. 
Recall that RTY is the number of units that get through all of the processes or 
process steps with no defects, ie., x = 0. If we let 6 = dpu then the RTY can 
be calculated as the probability of getting exactly 0 defects on a unit with an 


average defect rate of dpu, or RTY = e “’”. However, this approach can only 
be used when all of the process steps have the same dpu. This is seldom the 
case. If this approach is used for processes with unequal dpu’s, the calculated 
RTY will underestimate the actual RTY. For the example presented in Table 
13.2 we obtain the following results using this approach: 


a 1 
dpu = ype = ; (0.005 + 0.015 + 0.001 + 0.00005) = 0.005263 


Pa = Bees — 0.994751 


Note that this is considerably better than the 0.979 RTY calculated above. 
Since the individual process steps have greatly different dpu’s, the earlier esti- 
mate should be used. 


RTY worksheet 


RTY Capability 


RTY Actual 


Project RTY Goal 


Things to consider: 


How large are the gaps between the actual RTY, the capability RTY, and the 
project’s goal RTY? 


Does actual process performance indicate a need for a breakthrough project? 


Would we need a breakthrough project if we operated up to capability? 


Would focusing on a subset of CTXs achieve the project’s goals at lower cost? 
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Normalized yield and sigma level 
To compute the normalized yield, which is a kind of average, for an N- 
process or N-product department or organization, use following equation: 


Normalized Yield 


| (, _ DPMO, ,__ DPMO; | __ DPMOxy (13.12) 
— — — |] x — ——— _]... Ba 
1,000,000 1,000,000 1,000,000 


For example, consider a 4-process organization with the following DPMO 


levels for each process: 


PROCESS DPMO DPMO/1,000,000 | 1-(DPMO/1,000,000) 
Billing 5,000 0.005000 0.9950000 
Shipping 15,000 0.015000 0.9850000 
Manufacturing 1,000 0.001000 0.9990000 
Receiving 50 0.000050 0.9999500 


Normalized Yield = x/0.995 x 0.985 x 0.999 x 0.99995 = 0.99472 


Figure 13.11 shows the Excel spreadsheet for this example. 

The sigma level equivalent of this 4-process organization’s normalized yield 
is 4.1 (see Appendix, Table 18). This would be the estimated “organization” 
sigma level. Normalized yield should be considered a handy accounting device 
for measuring overall system quality. Because it is a type of average it is not 


= a G — . PS hs Fe: Normalized yield 
Sy Wie will Cc D 

1 Process DPMO DPMO/1,000,000 1-(DPMO/1,000,000) 
| 2 Billing 5,000 0.005 0.995 

3 Shipping 15,000 0.015 0.985 

4 Manufacturing 1,000 0.001 0.999 

5 Receiving 50 0.000 1.000 
6 NY | 0.99472] 


Figure 13.11. Excel spreadsheet for calculating normalized yield. 
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necessarily indicative of any particular product or process yield or of how the 
organization’s products will perform in the field. To calculate these refer to 
“Rolled throughput yield and sigma level” above. 


SOLVING FOR A DESIRED RTY 


Assuming every step has an equal yield, it is possible to “backsolve” to find 
the normalized yield required in order to get a desired RTY for the entire pro- 
cess, see Equation 13.13. 


Y, = VRTY =RTY% (13.13) 


where Y,, is the yield for an individual process step and N is the total number of 
steps. 

If the process yields are not equal, then Y,, is the required yield of the worst 
step in the process. For example, for a 10-step process with a desired RTY 
of 0.999 the worst acceptable yield for any process step is Y, = RTY'/? = 
(0.999)'/!°= 0.9999. If all other yields are not 100% then the worst-step yield 
must be even higher. 


FINDING RTY USING SIMULATION 


Unfortunately, finding the RTY isn’t always as straightforward as described 
above. In the real world you seldom find a series of process steps all neatly feed- 
ing into one another in a nice, linear fashion. Instead, you have different sup- 
plier streams, each with different volumes and different yields. There are steps 
that are sometimes taken and sometimes not. There are test and inspection 
stations, with imperfect results. There is rework and repair. The list goes on 
and on. In such cases it is sometimes possible to trace a particular batch of inputs 
through the process, monitoring the results after each step. However, this is 
often exceedingly difficult to control. The production and information systems 
are not designed to provide the kind of tracking needed to get accurate results. 
The usual outcome of such attempts is questionable data and disappointment. 

High-end simulation software offers an alternative. With simulation you can 
model the individual steps, then combine the steps into a process using the soft- 
ware. The software will monitor the results as it “runs” the process as often as 
necessary to obtain the accuracy needed. Figure 13.12 shows an example. Note 
that the Properties dialog box is for step 12 in the process (“Right Med?’’). The 
model is programmed to keep track of the errors encountered as a Med Order 
works its way through the process. Statistics are defined to calculate dpu and 
RTY for the process as a whole (see the Custom Statistics box in the lower 
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Figure 13.12. Finding RTY using simulation software (iGrafx Process for 
Six Sigma, Corel Corporation). 


right section of Figure 13.12). Since the process is non-linear (ie., it includes 
feedback loops) it isn’t a simple matter to determine which steps would have 
the greatest impact on RTY. However, the software lets the Black Belt test mul- 
tiple what-if scenarios to determine this. It can also link to Minitab or Excel to 
allow detailed data capture and analysis. 
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14 


Statistical Analysis of Cause 
and Effect 


TESTING COMMON ASSUMPTIONS 


Many statistical tests are only valid if certain underlying assumptions are 
met. In most cases, these assumptions are stated in the statistical textbooks 
along with the descriptions of the particular statistical technique. This chapter 
describes some of the more common assumptions encountered in Six Sigma 
project work and how to test for them. However, the subject of testing underly- 
ing assumptions is a big one and you might wish to explore it further with a 
Master Black Belt. 


Continuous versus discrete data 


Data come in two basic flavors: Continuous and Discrete. These data types 
are discussed elsewhere in this book. To review the basic idea, continuous data 
are numbers that can be expressed to any desired level of precision, at least in 
theory. For example, using a mercury thermometer I can say that the tempera- 
ture is 75 degrees Fahrenheit. With a home digital thermometer I could say it’s 
75.4 degrees. A weather bureau instrument could add additional decimal places. 
Discrete data can only assume certain values. For example, the counting num- 
bers can only be integers. Some survey responses force the respondent to choose 
a particular number from a list (pick a rating ona scale from 1 to 10). 
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Some statistical tests assume that you are working with either continuous or 
discrete data. For example, ANOVA assumes that continuous data are being 
analyzed, while chi-square and correspondence analysis assume that your data 
are counts. In many cases the tests are insensitive to departures from the data- 
type assumption. For example, expenditures can only be expressed to two deci- 
mal places (dollars and cents), but they can be treated as if they are continuous 
data. Counts can usually be treated as continuous data if there are many differ- 
ent counts in the data set. For example, if the data are defect counts ranging 
from 10 to 30 defects with all 21 counts showing up in the data (10, 11, 12,..., 
28, 29, 30). 


YOU HAVE DISCRETE DATA BUT NEED 
CONTINUOUS DATA 


In some cases, however, the data type matters. For example, if discrete data 
are plotted on control charts intended for continuous data the control limit 
calculations will be incorrect. Run tests and other non-parametric tests will 
also be affected by this. The problem of “discretized” data is often caused by 
rounding the data to too few decimal places when they are recorded. This 
rounding can be human caused, or it might be a computer program not 
recording or displaying enough digits. The simple solution is to record more 
digits. The problem may be caused by an inadequate measurement system. 
This situation can be identified by a measurement system analysis (see 
Chapter 10). The problem can be readily detected by creating a dot plot of 
the data. 


YOU HAVE CONTINUOUS DATA BUT NEED 
DISCRETE DATA 


Let’s say you want to determine if operator experience has an impact on 
the defects. One way to analyze this is to use a technique such as regression 
analysis to regress X = years of experience on Y = defects. Another would 
be to perform a chi-square analysis on the defects by experience level. To do 
this you need to put the operators into discrete categories, then analyze 
the defects in each category. This can be accomplished by “discretizing” the 
experience variable. For example, you might create the following discrete 
categories: 
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Experience (years) Experience Category 
Less than 1 New 

1to2 Moderately experienced 
3to5 Experienced 

More than 5 Very experienced 


The newly classified data are now suitable for chi-square analysis or other 
techniques that require discrete data. 


Independence assumption 


Statistical independence means that two values are not related to one 
another. In other words, knowing what one value is provides no information 
as to what the other value is. If you throw two dice and I tell you that one of 
them is a 4, that information doesn’t help you predict the value on the other 
die. Many statistical techniques assume that the data are independent. For 
example, if a regression model fits the data adequately, then the residuals will 
be independent. Control charts assume that the individual data values are inde- 
pendent; ie., knowing the diameter of piston 7/100 doesn’t help me predict 
the diameter of piston 7/101, nor does it tell me what the diameter of piston 
£99 was. If I don’t have independence, the results of my analysis will be 
wrong. I will believe that the model fits the data when it does not. I will tamper 
with controlled processes. 

Independence can be tested in a variety of ways. If the data are normal (test- 
ing the normality assumption is discussed below) then the run tests described 
for control charts can be used. 

A scatter plot can also be used. Let y = X,_, and plot X vs. Y. You will see 
random patterns if the data are independent. Software such as Minitab offer sev- 
eral ways of examining independence in time series data. Note: lack of indepen- 
dence in time series data is called autocorrelation. 

If you don’t have independence you have several options. In many cases the 
best course of action is to identify the reason why the data are not independent 
and fix the underlying cause. If the residuals are not independent, add terms to 
the model. If the process is drifting, add compensating adjustments. 

If fixing the root cause is not a viable option, an alternative is to use a statisti- 
cal technique that accounts for the lack of independence. For example, the 
EWMA control chart or a time series analysis that can model autocorrelated 
data. Another is to modify the technique to work with your autocorrelated 
data, such as using sloped control limits on the control chart. If data are cyclical 
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you can create uncorrelated data by using a sampling interval equal to the cycle 
length. For example, you can create a control chart comparing performance on 


Monday mornings. 


Normality assumption 


Statistical techniques such as t-tests, Z-tests, ANOVA, and many others 
assume that the data are at least approximately normal. This assumption is 
easily tested using software. There are two approaches to testing normality: 


graphical and statistical. 


GRAPHICAL EVALUATION OF NORMALITY 


One graphical approach involves plotting a histogram of the data, then super- 
imposing a normal curve over the histogram. This approach works best if you 
have at least 200 data points, and the more the merrier. For small data sets the 
interpretation of the histogram is difficult; the usual problem is seeing a lack of 
fit when none exists. In any case, the interpretation is subjective and two people 
often reach different conclusions when viewing the same data. Figure 14.1 
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Figure 14.1. Histograms with normal curves for different sample sizes. 
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shows four histograms for normally distributed data with mean=10, sigma=1 
and sample sizes ranging from 30 to 500. 

An alternative to the histogram/normal curve approach is to calculate a 
“goodness-of-fit” statistic and a P-value. This gives an unambiguous acceptance 
criterion; usually the researcher rejects the assumption of normality if 
P < 0.05. However, it has the disadvantage of being non-graphical. This violates 
the three rules of data analysis: 

1. PLOTTHE DATA 

2. PLOTTHE DATA 

3. PLOT THE DATA 

To avoid violating these important rules, the usual approach is to supplement 
the statistical analysis with a probability plot. The probability plot is scaled so 
that normally distributed data will plot as a straight line. Figure 14.2 shows the 
probability plots that correspond to the histograms and normal curves in 
Figure 14.1. The table below Figure 14.2 shows that the P-values are all comfor- 
tably above 0.05, leading us to conclude that the data are reasonably close to 
the normal distribution. 
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Figure 14.2. Normal probability plots and goodness of fit tests. 
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N 30 100 200 500 


P-Value 0.139 0.452] 0.816} 0.345 


WHAT TO DO IF THE DATA AREN’T NORMAL 


When data are not normal, the following steps are usually pursued: 

© Do nothing. Often the histogram or probability plot shows that the 
normal model fits the data well “where it counts.” If the primary inter- 
est is in the tails, for example, and the curve fits the data well there, 
then proceed to use the normal model despite the fact that the 
P-value is less than 0.05. Or if the model fits the middle of the distribu- 
tion well and that’s your focus, go with it. Likewise, if you have a 
very large sample you may get P-values greater than 0.05 even though 
the model appears to fit well everywhere. I work with clients who 
routinely analyze data sets of 100,000+ records. Samples this large 
will flag functionally and economically unimportant departures from 
normality as “statistically significant,” but it isn’t worth the time or 
the expense to do anything about it. 

© Transform the data. It is often possible to make the data normal by 
performing a mathematical operation on the data. For example, if 
the data distribution has very long tails to the high side, taking the 
logarithm often creates data that are normally distributed. Minitab’s 
control chart feature offers the Box-Cox normalizing power transfor- 
mation that works with many data distributions encountered in Six 
Sigma work. The downside to transforming is that data have to be 
returned to the original measurement scale before being presented to 
non-technical personnel. Some statistics can’t be directly returned to 
their original units; for example, if you use the log transform then 
you can’t find the mean of the original data by taking the inverse log 
of the mean of the transformed data. 

© Use averages. Averages are a special type of transformation because 
averages of subgroups always tend to be normally distributed, even if 
the underlying data are not. Sometimes the subgroup sizes required 
to achieve normality can be quite small. 

© Fit another statistical distribution. The normal distribution isn’t the 
only game in town. Try fitting other curves to the data, such as the 
Weibull or the exponential. Most statistics packages, such as 
Minitab, have the ability to do this. If you have a knack for program- 
ming spreadsheets, you can use Excel’s solver add-in to evaluate the 
fit of several distributions. 
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© Use a non-parametric technique. There are statistical methods, called 
non-parametric methods, that don’t make any assumptions about 
the underlying distribution of the data. Rather than evaluating the dif- 
ferences of parameters such as the mean or variance, non-parametric 
methods use other comparisons. For example, if the observations are 
paired they may be compared directly to see if the after is different 
than the before. Or the method might examine the pattern of points 
above and below the median to see if the before and after values are 
randomly scattered in the two regions. Or ranks might be analyzed. 
Non-parametric statistical methods are discussed later in this chapter. 


Equal variance assumption 


Many statistical techniques assume equal variances. ANOVA tests the 
hypothesis that the means are equal, not that variances are equal. In addition 
to assuming normality, ANOVA assumes that variances are equal for each 
treatment. Models fitted by regression analysis are evaluated partly by looking 
for equal variances of residuals for different levels of Xs and Y. 

Minitab’s test for equal variances is found in Stat > ANOVA > Test for 
Equal Variances. You need a column containing the data and one or more col- 
umns specifying the factor level for each data point. If the data have already 
passed the normality test, use the P-value from Bartlett’s test to test the equal 
variances assumption. Otherwise, use the P-value from Levene’s test. The test 
shown in Figure 14.3 involved five factor levels and Minitab shows a confidence 
interval bar for sigma of each of the five samples; the tick mark in the center of 
the bar represents the sample sigma. These are the data from the sample of 100 
analyzed earlier and found to be normally distributed, so Bartlett’s test can be 
used. The P-value from Bartlett’s test is 0.182, indicating that we can expect 
this much variability from populations with equal variances 18.2% of the time. 
Since this is greater than 5%, we fail to reject the null hypothesis of equal var- 
iances. Had the data not been normally distributed we would’ve used Levene’s 
test, which has a P-value of 0.243 and leads to the same conclusion. 


REGRESSION AND CORRELATION ANALYSIS 


Scatter plots 


Definition—A scatter diagram is a plot of one variable versus another. One 
variable is called the independent variable and it is usually shown on 
the horizontal (bottom) axis. The other variable is called the dependent 
variable and it is shown on the vertical (side) axis. 
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Test for Equal Variances 


95% Confidence Intervals for Sigmas Factor Levels 
oe——_s—____—-# 1 
Bartlett's Test 
Test Statistic: 6.233 
: P-Value : 0.182 
e 2 J 3 
Levene's Test 
® * o 4 Test Statistic: 1.391 
P-Value 10.243 
e * 2 5 
I I I I 
0.5 1.0 15 2.0 


Figure 14.3. Output from Minitab’s test for equal variances. 


Usage—Scatter diagrams are used to evaluate cause and effect relationships. 
The assumption is that the independent variable is causing a change in 
the dependent variable. Scatter plots are used to answer such questions 
as “Does vendor A’s material machine better than vendor B’s?” “Does 
the length of training have anything to do with the amount of scrap an 
operator makes?” and so on. 


HOW TO CONSTRUCT A SCATTER DIAGRAM 


1. Gather several paired sets of observations, preferably 20 or more. A 
paired set is one where the dependent variable can be directly tied to 
the independent variable. 

2. Find the largest and smallest independent variable and the largest and 
smallest dependent variable. 

3. Construct the vertical and horizontal axes so that the smallest and 
largest values can be plotted. Figure 14.4 shows the basic structure of a 
scatter diagram. 

4. Plot the data by placing a mark at the point corresponding to each X—-Y 
pair, as illustrated by Figure 14.5. If more than one classification is 
used, you may use different symbols to represent each group. 
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DESCRIPTIVE TITLE 


Largest Y value 


(or larger) 


Y AXIS Symbols representing 


X—Y pairs 


| Smallest Y value 
(or smaller) 


Smallest X value Largest X value 
(or smaller) (or larger) 


———- X AXIS —————> 


Figure 14.4. Layout of a scatter diagram. 


DESCRIPTIVE TITLE 


Largest Y value 


(or larger) 


Y AXIS “i 


| 


A point representing 
an X—Y pair 


Smallest Y value 
(or smaller) 


Smallest X value X; Largest X value 
(or smaller) (or larger) 


—-——— XaAxiS —> 


Figure 14.5. Plotting points on a scatter diagram. 
From Pyzdek’s Guide to SPC—Volume One: Fundamentals, p. 66. 
Copyright © 1990 by Thomas Pyzdek. 
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EXAMPLE OF A SCATTER DIAGRAM 
The orchard manager has been keeping track of the weight of peaches on a 
day by day basis. The data are provided in Table 14.1. 


Table 14.1. Raw data for scatter diagram. 
From Pyzdek’s Guide to SPC—Volume One: Fundamentals, p. 67. 
Copyright © 1990 by Thomas Pyzdek. 


NUMBER DAYS ON TREE WEIGHT (OUNCES) 
i 75 45 
2 76 45 
3 17 4.4 
4 78 4.6 
5 79 5.0 
6 80 4.8 
7 80 4.9 
8 81 5.1 
9 82 5.2 

10 82 5.2 
11 83 55 
12 84 5.4 
13 85 55 
14 85 55 
15 86 5.6 
16 87 5.7 
17 88 5.8 
18 89 5.8 
19 90 6.0 
20 90 6.1 


1. Organize the data into X—Y pairs, as shown in Table 14.1. The inde- 
pendent variable, X, is the number of days the fruit has been on the 
tree. The dependent variable, Y, is the weight of the peach. 

2. Find the largest and smallest values for each data set. The largest and 
smallest values from Table 14.1 are shown in Table 14.2. 
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Table 14.2. Smallest and largest values. 
From Pyzdek’s Guide to SPC—Volume One: Fundamentals, p. 68. 
Copyright © 1990 by Thomas Pyzdek. 


VARIABLE SMALLEST LARGEST 
Days on tree (X) 75 90 
Weight of peach (Y) 4,4 6.1 


3. Construct the axes. In this case, we need a horizontal axis that allows us 
to cover the range from 75 to 90 days. The vertical axis must cover the 
smallest of the small weights (4.4 ounces) to the largest of the weights 
(6.1 ounces). We will select values beyond these minimum requirements, 
because we want to estimate how long it will take for a peach to reach 
6.5 ounces. 

4. Plot the data. The completed scatter diagram is shown in Figure 14.6. 


POINTERS FOR USING SCATTER DIAGRAMS 


e Scatter diagrams display different patterns that must be interpreted; 
Figure 14.7 provides a scatter diagram interpretation guide. 


a2 SCATTER PLOT 


6.0 


WEIGHT 


4.5 


4.0 
70 75 80 85 90 95 


DAYS 


Figure 14.6. Completed scatter diagram. 
From Pyzdek’s Guide to SPC—Volume One: Fundamentals, p. 68. 
Copyright © 1990 by Thomas Pyzdek. 
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Strong positive Moderate positive No correlation 
correlation correlation 
Moderate negative Strong negative Curvilinear 
correlation correlation relationship 


Figure 14.7. Scatter diagram interpretation guide. 
From Pyzdek’s Guide to SPC—Volume One: Fundamentals, p. 69. 
Copyright © 1990 by Thomas Pyzdek. 


¢ Be sure that the independent variable, X, is varied over a sufficiently large 
range. When X is changed only a small amount, you may not see a cor- 
relation with Y, even though the correlation really does exist. 

e Ifyou make a prediction for Y, for an X value that lies outside of the range 
you tested, be advised that the prediction is highly questionable and 
should be tested thoroughly. Predicting a Y value beyond the X range 
actually tested is called extrapolation. 

¢ Keep an eye out for the effect of variables you didn’t evaluate. Often, an 
uncontrolled variable will wipe out the effect of your X variable. It is also 
possible that an uncontrolled variable will be causing the effect and you 
will mistake the X variable you are controlling as the true cause. This 
problem is much less likely to occur if you choose X levels at random. An 
example of this is our peaches. It is possible that any number of variables 
changed steadily over the time period investigated. It is possible that 
these variables, and not the independent variable, are responsible for the 
weight gain (e.g., was fertilizer added periodically during the time period 
investigated?). 
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¢ Beware of “happenstance” data! Happenstance data are data that were col- 
lectedin the past fora purpose different than constructinga scatter diagram. 
Since little or no control was exercised over important variables, you may 
find nearly anything. Happenstance data should be used only to get ideas 
for further investigation, never for reaching final conclusions. One 
common problem with happenstance data is that the variable that is truly 
important is not recorded. For example, records might show a correlation 
between the defect rate and the shift. However, perhaps the real cause of 
defects is the ambient temperature, which also changes with the shift. 

e If there is more than one possible source for the dependent variable, try 
using different plotting symbols for each source. For example, if the 
orchard manager knew that some peaches were taken from trees near a 
busy highway, he could use a different symbol for those peaches. He 
might find an interaction, that is, perhaps the peaches from trees near the 
highway have a different growth rate than those from trees deep within 
the orchard. 

Although it is possible to do advanced analysis without plotting the scatter 

diagram, this is generally bad practice. This misses the enormous learning 
opportunity provided by the graphical analysis of the data. 


Correlation and regression 


Correlation analysis (the study of the strength of the linear relationships 
among variables) and regression analysis (modeling the relationship between 
one or more independent variables and a dependent variable) are activities of 
considerable importance in Six Sigma. A regression problem considers the fre- 
quency distributions of one variable when another is held fixed at each of several 
levels. A correlation problem considers the joint variation of two variables, 
neither of which is restricted by the experimenter. Correlation and regression 
analyses are designed to assist the analyst in studying cause and effect. They 
may be employed in all stages of the problem-solving and planning process. Of 
course, statistics cannot by themselves establish cause and effect. Proving 
cause and effect requires sound scientific understanding of the situation at 
hand. The statistical methods described in this section assist the analyst in 
performing this task. 


LINEAR MODELS 


A linear model is simply an expression of a type of association between two 
variables, x and y. A linear relationship simply means that a change of a given 
size in x produces a proportionate change in y. Linear models have the form: 
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y =atbx (14.1) 


where a and J are constants. The equation simply says that when x changes by 
one unit, y will change by 4 units. This relationship can be shown graphically. 

In Figure 14.8, a = 1 and b = 2. The term a is called the intercept and D is 
called the slope. When x = 0, y is equal to the intercept. Figure 14.8 depicts a 
perfect linear fit, e.g., if x is known we can determine y exactly. Of course, per- 
fect fits are virtually unknown when real data are used. In practice we must 
deal with error in x and y. These issues are discussed below. 
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Figure 14.8. Scatter diagram of a linear relationship. 


Many types of associations are non-linear. For example, over a given range of 
x values, y might increase, and for other x values, y might decrease. This curvi- 
linear relationship is shown in Figure 14.9. 

Here we see that y increases when x increases and is less than 1, and decreases 
as x increases when x is greater than 1. Curvilinear relationships are valuable 
in the design of robust systems. A wide variety of processes produces such rela- 
tionships. 

It is often helpful to convert these non-linear forms to linear form for analysis 
using standard computer programs or scientific calculators. Several such trans- 
formations are shown in Table 14.3. 
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12 


10 


Figure 14.9. Scatter diagram of a curvilinear relationship. 


Fit the straight line Yy = by) + b,X 7 using the usual linear regression proce- 
dures (see below). In all formulas, substitute Y for Y and Xy for X. A simple 
method for selecting a transformation is to simply program the transformation 
into a spreadsheet and run regressions using every transformation. Then select 
the transformation which gives the largest value for the statistic R*. 

There are other ways of analyzing non-linear responses. One common 
method is to break the response into segments that are piecewise linear, and 
then to analyze each piece separately. For example, in Figure 14.9 y is roughly 
linear and increasing over the range 0 < x < 1 and linear and decreasing over 
the range x > 1. Of course, if the analyst has access to powerful statistical soft- 
ware, non-linear forms can be analyzed directly. 

When conducting regression and correlation analysis we can distinguish two 
main types of variables. One type we call predictor variables or independent 
variables; the other, response variables or dependent variables. By predictor 
independent variables we usually mean variables that can either be set to a 
desired variable (e.g., oven temperature) or else take values that can be observed 
but not controlled (e.g., outdoors ambient humidity). As a result of changes 
that are deliberately made, or simply take place in the predictor variables, an 
effect is transmitted to the response variables (e.g., the grain size of a composite 
material). We are usually interested in discovering how changes in the predictor 
variables affect the values of the response variables. Ideally, we hope that a 
small number of predictor variables will “explain” nearly all of the variation in 
the response variables. 
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Table 14.3. Some linearizing transformations. 
(Source: Experimental Statistics, NBS Handbook 91, pp. 5-31.) 


CONVERT 
STRAIGHT LINE 
CONSTANTS (Bo 
PLOT THE AND B,) TO 
RELATIONSHIP IS VARIABLES CONSTANTS 
OF THE FORM: Yr Xr by b, 
Y=a+— 
= + bX 
Y a 
ae: 
~— atbx 
Y =ab* 
y= Peds 
Y =ax’ 
Y =a+bx" 
where 7 is known 


In practice, it is sometimes difficult to draw a clear distinction between inde- 
pendent and dependent variables. In many cases it depends on the objective of 
the investigator. For example, an analyst may treat ambient temperature as a 
predictor variable in the study of paint quality, and as the response variable in 
a study of clean room particulates. However, the above definitions are useful 
in planning Six Sigma studies. 

Another idea important to studying cause and effect is that of the data space 
of the study The data space of a study refers to the region bounded by the 
range of the independent variables under study. In general, predictions based 
on values outside the data space studied, called extrapolations, are little more 
than speculation and not advised. Figure 14.10 illustrates the concept of data 
space for two independent variables. Defining the data space can be quite tricky 
when large numbers of independent variables are involved. 
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Point outside 
the data space 


Figure 14.10. Data space. 


While the numerical analysis of data provides valuable information, it 
should always be supplemented with graphical analysis as well. Scatter dia- 
grams are one very useful supplement to regression and correlation analysis. 
Figure 14.11 illustrates the value of supplementing numerical analysis with 
scatter diagrams. 


I I Il IV 

Xx Y x Y, Xx x Xx Y 
10 8.04 10 9.14 10 7.46 8 6.58 
8 6.95 8 8.14 8 6.77 8 5.76 
13 7.38 13 8.74 13 12.74 8 7.71 
9 8.81 9 8.77 9 7.11 8 8.84 
11 8.33 11 9.26 11 7.81 8 8.47 
14 9.96 14 8.10 14 8.84 8 7.04 
7.24 6 6.13 6 6.08 8 5.25 
4 4.26 4 3.10 4 5.39 19 12.50 
12 10.84 12 9.13 12 8.15 8 5.56 
7 4.82 7 7.26 7 6.42 8 7.91 
5 5.68 5 4.74 5 5.73 8 6.89 


Figure 14.11. Illustration of the value of scatter diagrams. 
(Source: The Visual Display of Quantitative Information, Edward R. Tufte, pp. 13-14.) 


Continued on next page... 
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Figure 14.11—Continued ... 


Statistics for Processes I-IV 


n= Il 
xX = 9.0 
Y=7.5 


best fit line: Y = 3+ 0.5X 
standard error of slope: 0.118 
t= 4.24 


\OxX-X= 110.0 


regression SS = 27.50 
residual SS = 13.75 


r = 0.82 
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127 10 
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Figure 14.11. Illustration of the value of scatter diagrams. 
(Source: The Visual Display of Quantitative Information, Edward R. Tufte, pp. 13-14.) 
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In other words, although the scatter diagrams clearly show four distinct pro- 
cesses, the statistical analysis does not. In Six Sigma, numerical analysis alone 
is not enough. 


LEAST-SQUARES FIT 


If all data fell ona perfectly straight line it would be easy to compute the slope 
and intercept given any two points. However, the situation becomes more com- 
plicated when there is “scatter” around the line. That is, for a given value of x, 
more than one value of y appears. When this occurs, we have error in the 
model. Figure 14.12 illustrates the concept of error. 


25 


Line 
The least-squares line is found so that 
the sum of the squares of all of the 
vertical deviations from the line is 

as small as possible 


20 


15 


10 


deviation #2 


deviation #3 


deviation #1 


Figure 14.12. Error in the linear model. 


The model for a simple linear regression with error is: 
y=atbxt+e (14.2) 


where € represents error. Generally, assuming the model adequately fits the 
data, errors are assumed to follow a normal distribution with a mean of O anda 
constant standard deviation. The standard deviation of the errors is known as 
the standard error. We discuss ways of verifying our assumptions below. 
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When error occurs, as it does in nearly all “real-world” situations, there are 
many possible lines which might be used to model the data. Some method 
must be found which provides, in some sense, a “best-fit” equation in these 
everyday situations. Statisticians have developed a large number of such meth- 
ods. The method most commonly used in Six Sigma finds the straight line that 
minimizes the sum of the squares of the errors for all of the data points. This 
method is known as the “least-squares” best-fit line. In other words, the least- 
squares best-fit line equation is y; = a + bx; where a and b are found so that 
the sum of the squared deviations from the line is minimized. The best-fit 
equations for a and Bare: 


oe Ree — XVM —Y) 
&%, — XY 


(14.3) 


a=Y—bxX (14.4) 


where the sum is taken over all 7 values. Most spreadsheets and scientific cal- 
culators have a built-in capability to compute a and B. As stated above, there 
are many other ways to compute the slope and intercept (e.g, minimize the 
sum of the absolute deviations, minimize the maximum deviation, etc.); in cer- 
tain situations one of the alternatives may be preferred. The reader is advised 
to consult books devoted to regression analysis for additional information 
(see, for example, Draper and Smith (1981)). 

The reader should note that the fit obtained by regressing x on y will not in 
general produce the same line as would be obtained by regressing y on x. This 
is illustrated in Figure 14.13. 

When weight is regressed on height the equation indicates the average weight 
(in pounds) for a given height (in inches). When height is regressed on weight 
the equation indicates the average height for a given weight. The two lines inter- 
sect at the average height and weight. 

These examples show how a single independent variable is used to model the 
response of a dependent variable. This is known as simple linear regression. It 
is also possible to model the dependent variable in terms of two or more inde- 
pendent variables; this is known as multiple linear regression. The mathematical 
model for multiple linear regression has additional terms for the additional 
independent variables. Equation 14.5 shows a linear model when there are two 
independent variables. 


y =a + byx, + box, +eE (14.5) 
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Figure 14.13. Least-squares lines of weight vs. height and height vs. weight. 


where x1, x7 are independent variables, b; is the coefficient for x, and J, is the 
coefficient for x). 


Example of regression analysis 

A restaurant conducted surveys of 42 customers, obtaining customer ratings 
on staff service, food quality, and overall satisfaction with their visit to the res- 
taurant. Figure 14.14 shows the regression analysis output from a spreadsheet 
regression function (Microsoft Excel). 

The data consist of two independent variables, staff and food quality, and a 
single dependent variable, overall satisfaction. The basic idea is that the quality 
of staff service and the food are causes and the overall satisfaction score is an 
effect. The regression output is interpreted as follows: 

Multiple R—the multiple correlation coefficient. It is the correlation 
between y and y. For the example: multiple R = 0.847, which indicates 
that y and y are highly correlated, which implies that there is an asso- 
ciation between overall satisfaction and the quality of the food and 
service. 
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Regression statistics 


Multiple R 


Standard error 


Observations 


ANOVA 


Regression 


Intercept f 1188 | 0.565 :-2.102 | 0.042 | 


df 5S i oms } F Significance F' 
28.97 {1449 | 4943 | 0.00 | 


Al 40.40 


| Coefficients Standard error | t Stat | P-value | Lower 95% | Upper 95% 


0.379 0.163 | 2.325 0.025 ; 0.049 . 0.710 


Figure 14.14. Regression analysis output. 


R square—the square of multiple R, it measures the proportion of total var- 
iation about the mean Y explained by the regression. For the example: 
R* = 0.717, which indicates that the fitted equation explains 71.7% of 
the total variation about the average satisfaction level. 

Adjusted R square—a measure of R’ “adjusted for degrees of freedom.” The 
equation is 


as 
Adjusted R? = 1 — (1 — R’) (: ) (14.6) 
n—p 


where p is the number of parameters (coefficients for the xs) estimated 
in the model. For the example: p = 2, since there are two x terms. 
Some experimenters prefer the adjusted R* to the unadjusted R’, 
while others see little advantage to it (e.g., Draper and Smith, 1981, p. 
92). 

Standard error—the standard deviation of the residuals. The residual is the 
difference between the observed values of y and the predicted values 
based on the regression equation. 

Observations—refer to the number of cases in the regression analysis, or 7. 
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ANOVA, or ANalysis Of VAriance—a table examining the hypothesis that 
the variation explained by the regression is zero. If this is so, then the 
observed association could be explained by chance alone. The rows 
and columns are those of a standard one-factor ANOVA table (see 
Chapter 17). For this example, the important item is the column labeled 
“Significance F.” The value shown, 0.00, indicates that the probability 
of getting these results due to chance alone is less than 0.01; i-e., the asso- 
ciation is probably not due to chance alone. Note that the ANOVA 
applies to the entire model, not to the individual variables. 

The next table in the output examines each of the terms in the linear model 
separately. The intercept is as described above, and corresponds to our term a 
in the linear equation. Our model uses two independent variables. In our ter- 
minology staff = b,, food = b,. Thus, reading from the coefficients column, the 
linear model is: y = —1.188 + 0.902 x staff score + 0.379 x food score. The 
remaining columns test the hypotheses that each coefficient in the model is 
actually zero. 

Standard error column—gives the standard deviations of each term, ie., the 

standard deviation of the intercept = 0.565, etc. 

t Stat column—the coefficient divided by the standard error, i-e., it shows 
how many standard deviations the observed coefficient is from zero. 

P-value—shows the area in the tail of az distribution beyond the computedt 
value. For most experimental work, a P-value less than 0.05 is accepted 
as an indication that the coefficient is significantly different than zero. 
All of the terms in our model have significant P-values. 

Lower 95% and Upper 95% columns—a 95% confidence interval on the 
coefficient. If the confidence interval does not include zero, we will 
fail to reject the hypothesis that the coefficient is zero. None of the 
intervals in our example include zero. 


CORRELATION ANALYSIS 


As mentioned earlier, a correlation problem considers the joint variation of 
two variables, neither of which is restricted by the experimenter. Unlike regres- 
sion analysis, which considers the effect of the independent variable(s) on a 
dependent variable, correlation analysis is concerned with the joint variation 
of one independent variable with another. In a correlation problem, the analyst 
has two measurements for each individual item in the sample. Unlike a regres- 
sion study where the analyst controls the values of the x variables, correlation 
studies usually involve spontaneous variation in the variables being studied. 
Correlation methods for determining the strength of the linear relationship 
between two or more variables are among the most widely applied statistical 


Regression and correlation analysis 513 


techniques. More advanced methods exist for studying situations with more 
than two variables (e.g., canonical analysis, factor analysis, principal compo- 
nents analysis, etc.), however, with the exception of multiple regression, our dis- 
cussion will focus on the linear association of two variables at a time. 

In most cases, the measure of correlation used by analysts is the statistic r, 
sometimes referred to as Pearson’s product-moment correlation. Usually x and 
y are assumed to have a bivariate normal distribution. Under this assumption r 
is a sample statistic which estimates the population correlation parameter /. 
One interpretation of r is based on the linear regression model described earlier, 
namely that r* is the proportion of the total variability in the y data which can 
be explained by the linear regression model. The equation for r is: 


Sxy Dy kD 


A ee — he (14.7) 


sy Vip x = (Ox) Oy? — (71 


and, of course, r* is simply the square of r. r is bounded at —1 and +1. When the 
assumptions hold, the significance of r is tested by the regression ANOVA. 

Interpreting r can become quite tricky, so scatter plots should always be used 
(see above). When the relationship between x and y is non-linear, the “explana- 
tory power” ofr is difficult to interpret in precise terms and should be discussed 
with great care. While it is easy to see the value of very high correlations such 
as r = 0.99, it is not so easy to draw conclusions from lower values of r, even 
when they are statistically significant (i.e., they are significantly different than 
0.0). For example, r = 0.5 does not mean the data show half as much clustering 
as a perfect straight-line fit. In fact,r = 0 does not mean that there is no relation- 
ship between the x and y data, as Figure 14.15 shows. When r > 0, y tends to 
increase when x increases. Whenr < 0, y tends to decrease when x increases. 

Althoughr = 0, the relationship between x andy is perfect, albeit non-linear. 

At the other extreme,r = 1,a “perfect correlation,” does not mean that there 
is a cause and effect relationship between x and y. For example, both x and y 
might be determined by a third variable, z. In such situations, z is described as 
a lurking variable which “hides” in the background, unknown to the exper- 
imenter. Lurking variables are behind some of the infamous silly associations, 
such as the association between teacher’s pay and liquor sales (the lurking vari- 
able is general prosperity).” 


*It is possible to evaluate the association of x and y by removing the effect of the lurking variable. This can be done using 
regression analysis and computing partial correlation coefficients. This advanced procedure is described in most texts on 


regression analysis. 
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Figure 14.15. Interpreting r = 0 for curvilinear data. 


Establishing causation requires solid scientific understanding. Causation 
cannot be “proven” by statistics alone. Some statistical techniques, such as 
path analysis, can help determine if the correlations between a number of vari- 
ables are consistent with causal assumptions. However, these methods are 
beyond the scope of this book. 


ANALYSIS OF CATEGORICAL DATA 
Chi-square, tables 
MAKING COMPARISONS USING CHI-SQUARE TESTS 


In Six Sigma, there are many instances when the analyst wants to compare 
the percentage of items distributed among several categories. The things might 
be operators, methods, materials, or any other grouping of interest. From each 
of the groups a sample is taken, evaluated, and placed into one of several cate- 
gories (e.g., high quality, marginal quality, reject quality). The results can be pre- 
sented as a table with m rows representing the groups of interest and k 
columns representing the categories. Such tables can be analyzed to answer the 
question “Do the groups differ with regard to the proportion of items in the 
categories?” The chi-square statistic can be used for this purpose. 
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EXAMPLE OF CHI-SQUARE TEST 


The following example is from Natrella (1963). 

Rejects of metal castings were classified by cause of rejection for three dif- 
ferent weeks, as given in the following tabulation. The question to be answered 
is: Does the distribution of rejects differ from week to week? 


CAUSE OF REJECTION 


Sand | Misrun | Shift 


Drop | Corebreak | Broken | Other | Total 


cell. This is done using the equation: 


Week 1 |] 97 8 18 23 21 5 180 
Week 2 || 120 15 12 21 17 15 215 
| Week 3 | 25 19 180 
Total 63 39 573 


Chi-square (x’) is computed by first finding the expected frequencies in each 


Frequency expected = f, = 


Row sum X column sum 


overall sum 


For example, for week 1, the frequency expected of sand rejects is (180 x 299)/ 
573 = 93.93. The table below shows the frequency expected for the remainder 
of the cells. 


| Sand | Misrun 


Shift 


Drop | Corebreak | Broken | Other 


Week 1 93.93 8.48 9.42 10.37 25.76 19.79 12.25 
Week 2 111.15 10.04 11.15 12.27 30.48 23.42 14.50 
Week 3 93.93 8.48 9.42 10.37 25.76 19.79 12.25 


The next step is to compute x” as follows: 


f= 5 


over all cells 
_ (93.93 — 97)" (12.25 — 19)° 
93,93 


(Frequency expected — Frequency observed)’ 


Frequency expected 


= 45.60 
12.25 
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Next choose a value for @; we will use ~@ = 0.10 for this example. The degrees 
of freedom for the x7 test are (k — 1)(m — 1) = 12. Referring to Table 4 in the 
Appendix we find the critical value of x7 = 18.55 for our values. Since our com- 
puted value of x7 exceeds the critical value, we conclude that the weeks differ 
with regard to proportions of various types of defectives. 


Logistic regression 


INTRODUCTION TO LOGISTIC REGRESSION 


Logistic regression, like least squares regression, investigates the relationship 
between a response variable and one or more predictors. However, linear regres- 
sion is used when response variables are continuous, while logistic regression 
techniques are used with categorical response variables. We will look at three 
different types of logistic regression, based on the type of response variable 
being analyzed (see Table 14.4.) 


Table 14.4. Types of logistic regression analysis. 


RESPONSE 
VARIABLE AND 
LOGISTIC NUMBER OF 
REGRESSION RESPONSE RESPONSE 
TYPE CATEGORIES | CHARACTERISTICS] EXAMPLES 
Binary 2 two levels Go/not-go, pass/fail, 
buy/doesn’t buy, yes/no, 
recovers/dies, male/female 
Ordinal 3 or more natural ordering of the | Dissatisfied/neutral/satisfied, 
levels none/mild/severe, 
fine/medium/coarse 
Nominal 3 or more no natural ordering of | Black/white/Hispanic, black 
the levels hair/brown hair/blonde hair, 
sunny/rainy/cloudy 


The basic idea behind logistic regression is very simple, as shown in Figure 


14.16. X is a hypothetical “cause” of a response. X can be either continuous or 
categorical. Y is an event that we are interested in and it must be categorical. A 
model can have multiple Xs, but only one response variable. For example, Y 
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Proportion 


Responding 


x 


Figure 14.16 Logistic regression. 


might be whether a prospect purchased a magazine or not, and Xs might be the 
age and race of the prospect. The model would produce a prediction of the prob- 
ability of a magazine being purchased based on the age and race of the prospect, 
which might be used to prioritize a list for telemarketing purposes. 


THE LOGIT 


Figure 14.16 illustrates a direct modeling of the proportion responding versus 
a predictor variable. The problem is that in the real world the response pattern 
can take on a wide variety of forms and a simple model of the proportion 
responding as a function of predictors isn’t flexible enough to take on all of the 
various shapes. The solution to this is to use a mathematical function, called 
the logit, that makes it possible to develop versatile models. The formula for 
the logit is shown in Equation 14.8. Although it looks intimidating, it is really 
very similar to the equation for a linear regression. Notice that e is raised to a 
power that is just a linear function of the Xs. In fact, the power term is just the 
multiple linear regression model. However, where linear regression can only 
model straight-line functions, the logit takes on a wide variety of curve shapes 
as the estimates of the parameters vary. Figure 14.17 shows logit curves for a 
few values of 8, with & held constant at 0 (changing @ would result in shifting 
the curves left or right). 


ett Bint Boxet AB, Xp 
(14.8) 


P(x) ms 1+ ett Bix tBox2t  +BixXn 
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P(x) = exp(0+BX)/(1+exp(0+BX)) | The Logit 
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Figure 14.17. Plot of the logit for a = 0, B varies. 

Odds ratios 


When the logit link is used (it’s the default in most software packages, includ- 
ing Minitab), logistic regression evaluates the odds of some event of interest 
happening versus the odds of it not happening. This is done via odds ratios. 
“Odds” and probabilities are similar, but not identical. In a standard deck of 
cards there are 13 different card values, ace, king, queen, etc. The odds of a ran- 
domly selected card being an ace is 12-to-1, ie., there are 12 non-aces to 1 ace. 
The probability of selecting an ace is 1-in-13, ie., there are 13 choices of which 
1 is an ace. In most statistical analyses used in Six Sigma work we use probabil- 
ities, but logistic regression uses odds for its calculations. 

Consider a Six Sigma project involving a web site. The goal of the project is to 
make it easier for customers to find what they are looking for. A survey was 
administered to people who visited the web site and the results in Table 14.5 


Table 14.5. Odds ratio example. 


WEB SITE DESIGN FOUND ANSWER DIDN’T FIND ANSWER 
Old 50 169 
New 26 46 
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were obtained. The Black Belt wants to know if the design change had an impact 
on the customer’s ability to find an answer to their question. 
The odds ratio for these data is calculated as follows: 


Odds of finding answer with old design = 50/169 = 0.296 
Odds of finding answer with new design = 26/46 = 0.565 
Odds ratio = 0.565/0.296 = 1.91 


It can be seen that the odds of the customer finding the answer appears to be 
91% better with the new design than with the old design. However, to interpret 
this result properly we must know if this improvement is statistically sig- 
nificant. We can determine this by using binary logistic regression. 

Note: another way to analyze these data is to use chi-square. Logistic regres- 
sion, in addition to providing a predictive model, will sometimes work when 
chi-square analysis will not. 


BINARY LOGISTIC REGRESSION 


Minitab’s binary logistic regression function is located in the 
Stat>Regression menu. The data must be arranged in one of the formats 
Minitab accepts. Minitab’s Binary Logistic Regression dialog box (Figure 
14.18), shows the input for this problem in columns C1, C2, C3, and C4. 
Column C4 is a code value that is 0 if the customer visited after the change, 1 
otherwise. 


Interpreting Minitab’s binary logistic regression output 

There is a great deal of information displayed in Figure 14.19; let’s take a 
closer look at it. At the top we see that Minitab used the logit link in the 
analysis, which is its default. Next Minitab summarizes the response informa- 
tion, which matches the input in Table 14.5—(odds ratio example). Next we 
see the predictive model coefficients. The coefficient labeled “Constant” 
(0.5705) is the value for a in Equation 14.8, and the coefficient labeled 
“WhenCode’” is the coefficient for 8. The P column is the test for significance 
and P < 0.05 is the critical value. Since P < 0.05 for both the constant and the 
WhenCode, we conclude that the constant is not zero and that when the data 
were taken (before or after the design change) made a difference. 

In the WhenCode row we have three additional columns: odds ratio, 95% 
confidence interval lower limit and 95% confidence interval upper limit. The 
odds ratio is the 1.91 we calculated directly earlier. The 95% confidence interval 
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Figure 14.18. Minitab’s Binary Logistic Regression dialog box. 


on the odds ratio goes from 1.07 to 3.40. If the design change made no difference, 
the expected value of the odds ratio would be 1.00. Since the interval doesn’t 
include 1.00 we conclude (at 95% confidence) that the design change made a dif- 
ference. This conclusion is confirmed by the P-value of 0.029 for the test that 
all slopes are equal (testing for equal slopes is equivalent to testing the null 
hypothesis that the design change had no effect). 

Had we had a covariate term (an X ona continuous scale) Minitab would’ve 
performed a goodness of fit test by dividing the data into 10 groups and perform- 
ing a chi-square analysis of the resulting table. 

Next Minitab compares the predicted probabilities with the actual 
responses. The data are compared pairwise, predicted: found and not found vs. 
actual: found and not found. A pair is “concordant” if actual and predicted cate- 
gories are the same, “discordant” if they are different, and “tied” otherwise. 
Table 14.6 shows the classifications for our example. 

The total number of found times not found pairs is 76 x 215 = 16340. 
The total number of concordant pairs is 169 x 26 = 4394. The total number of 
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Binary Logistic Regression: Outcome versus WhenCode 
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opposite is true, tied if probabilities are equal. 


Figure 14.19. Output from Minitab binary logistic regression. 


discordant pairs is 50 x 46 = 2300. The remaining 16340 — 4394 — 2300 = 
9646 pairs are ties. The model correctly discriminated between and classified 
the concordant pairs, or 27%. It incorrectly classified the discordant pairs, or 14%. 

Somers’ D, Goodman-Kruskal Gamma, and Kendall’s Tau-a are summaries 
of the table of concordant and discordant pairs. The numbers have the same 


Table 14.6. Concordant and discordant results. 


CORRECT | INCORRECT ACTUAL 
DESIGN RESULT RESULT COUNT RESULT 


Not found 169 Concordant 
Old 


Discordant 


Found 26 Concordant 


Not Found 46 Discordant 


New 
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numerator: the number of concordant pairs minus the number of discordant 
pairs. The denominators are the total number of pairs with Somers’ D, the 
total number of pairs excepting ties with Goodman-Kruskal Gamma, and the 
number of all possible observation pairs for Kendall’s Tau-a. These measures 
most likely lie between 0 and 1 where larger values indicate a better predictive 
ability of the model. The three summary measures of fit range between 0.05 
and 0.31. This isn’t especially impressive, but the P-value and the concordance/ 
discordance analysis indicate that it’s better than randomly guessing. 


Conclusion 

The main conclusion is found in the odds ratio and P-value. The new design is 
better than the original design. The mediocre predictability of the model indi- 
cates that there’s more to finding the correct answer than the different web 
designs. In this case it would probably pay to continue looking for ways to 
improve the process, only 36% of the customers find the correct answer (a pro- 
cess sigma that is less than zero!). 


ORDINAL LOGISTIC REGRESSION 


If the response variable has more than two categories, and if the categories 
have a natural order, then use ordinal logistic regression. Minitab’s procedure 
for performing this analysis assumes parallel logistic regression lines. You may 
also want to perform a nominal logistic regression, which doesn’t assume paral- 
lel regression lines, and compare the results. An advantage to using ordinal logis- 
tic regression is that the output includes estimated probabilities for the 
response variables as a function of the factors and covariates. 


Ordinal logistic regression example 

A call center conducted a survey of its customers to determine the impact of 
various call center variables on overall customer satisfaction. Customers were 
asked to read a statement, then to respond by indicating the extent of their 
agreement with the statement. The two survey items we will analyze are: 

Q3: The technical support representative was professional. (X) 

Q17:I plan to use XXX in the future, should the need arise. (Y) 

Customers were asked to choose one of the following responses to each ques- 
tion: 

1. Istrongly disagree with the statement. 

2. Idisagree with the statement. 

3. I neither agree nor disagree with the statement. 
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4. agree with the statement. 

5. Istrongly agree with the statement. 

The results are shown in Table 14.7. Table 14.8 presents the first part of the 
Minitab worksheet for the data—note that this is the same information as in 
Table 14.7, just rearranged. There is one row for each combination of responses 


to Q3 and Q17. 


Table 14.7. Survey response cross-tabulation. 


FREQUENCY TABLE 
| _Q17 RESPONSE 
5 
9 
3 
10 
119 
5 QO] 2 14] 136] 303 


Table 14.8. Table 14.7 data reformatted for Minitab. 


Q3RESPONSE FREQ Q17RESPONSE 
1 7 1 
2 5 1 
3 4 1 
4 7 1 
5 0 1 
1 6 2 
2 2 2 
Etc. Etc. Etc. 


Minitab’s dialog box for this example is shown in Figure 14.20. The storage 
dialog box allows you to tell Minitab to calculate the probabilities for the 
various responses. I also recommend telling Minitab to calculate the number 
of occurrences so that you can cross check your frequencies with Minitab’s to 
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Figure 14.20. Ordinal Logistic Regression Minitab dialog boxes. 


assure that you have the data in the correct format. When you tell Minitab 
to store results, the information is placed in new columns in your active 
worksheet, not in the session window. Note the data entries for the response, 
frequency, model, and factors. 

Minitab’s session window output is shown in Figure 14.21. For simplicity 
only part of the output is shown. The goodness-of-fit statistics (concordance, 
discordance, etc.) have been omitted, but the interpretation is the same as for 
binary logistic regression. Minitab needs to designate one of the response values 
as the reference event. Unless you specifically choose a reference event, 
Minitab defines the reference event based on the data type: 

© For numeric factors, the reference event is the greatest numeric value. 

© For date/time factors, the reference event is the most recent date/ 
time. 

© For text factors, the reference event is the last in alphabetical order. 

A summary of the interpretation follows: 

© The odds of a reference event is the ratio of P(event) to P(not event). 

© The estimated coefficient can also be used to calculate the odds ratio, 
or the ratio between two odds. Exponentiating the parameter estimate 
of a factor yields the ratio of P(event)/P(not event) for a certain factor 
level compared to the reference level. 
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Ordinal Logistic Regression: Q17RESPONSE versus Q3RESPONSE 


Link Function: Logit 


Response Information 


Variable Value Count 
QI7RESPO 1 23 
2 aby) 
3 73 
4 439 
5 444 
Total 996 


Frequency: FREQ 
24 cases were used 
1 cases contained missing values 


or was a case with zero frequency. 


Logistic Regression Table 


Odds 95% CI 
Predictor Coef SE Coef Z P Ratio Lower Upper 
Const (1) -2.0630 0.3358 -6.14 0.000 
Const (2) -1.4516 0.3094 -4.69 0.000 
Const (3) -0.1995 0.2926 -0.68 0.496 
Const (4) 2.5735 0.3121 8.25 0.000 
Q3RESPON 
Zz -0.0905 0.4253 -0.21 0.831 0.91 0.40 2.10 
3 -0.5898 0.3638 -1.62 0.105 0.55 0.27 13413 
4 -1.8408 0.3176 -5.80 0.000 0.16 0.09 0.30 
5 325/71. 0.3254 -10.01 0.000 0.04 0.02 0.07 


Log-likelihood = -941.733 
Test that all slopes are zero: G = 246.547, DF = 4, P-Value = 0.000 


Figure 14.21. Minitab ordinal logistic regression session window output. 


Youcan change the default reference event in the Options subdialog box. For 
our example, category 5 (strongly agree) is the reference event. The odds ratios 
are calculated as the probability of the response being a 5 versus the probability 
that it is not a 5. For factors, the smallest numerical value is the reference 
event. For the example, this is a Q3 response of 1. 

The odds ratios and their confidence intervals are given near the bottom of 
the table. A negative coefficient and an odds ratio less than 1 indicate that 
higher responses to Q17 tend to be associated with higher responses to Q3. 
Odds ratios whose confidence intervals do not include 1.00 are statistically 
significant. For the example, this applies to responses of 4 or 5 to Q3, ie, a 
customer who chooses a 4 or 5 in response to Q3 is more likely to choose a 
5 in response to Q17. 

The statistical probabilities stored by Minitab are plotted in Figure 14.22. 
The lines for Q3=4 and Q3 =5, the factor categories with significant odds 
ratios, are shown as bold lines. Note that the gap between these two lines and 
the other lines is greatest for Q17 = 5. 
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Probability 


Overall Satisfaction vs. Technician Satisfaction 
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Figure 14.22. Minitab stored results. 


NOMINAL LOGISTIC REGRESSION 


Nominal logistic regression, as indicated in Table 14.4, is used when the 
response is categorical, there are two or more response categories, and there is 
no natural ordering of the response categories. It can also be used to evaluate 
whether the parallel line assumption of ordinal logistic regression is reasonable. 


Example of nominal logistic regression 

Upon further investigation the Master Black Belt discovered that the Black 
Belt working on the web site redesign project described in the binary logistic 
regression example section above had captured additional categories. Rather 
than just responding that the answer to their question was found or not found, 
there were several other response categories (Figures 14.23 and 14.24). Since 
the various not found subcategories have no natural order, nominal logistic 
regression is the correct procedure for analyzing these data. 

The result of Minitab’s analysis, shown in Figure 14.25, shows that only the 
odds ratio for found and worked versus not found is significant. The confidence 
interval for all other found subcategories compared with found and worked 
includes 1.00. The family P-value is a significance test for all comparisons simul- 
taneously. Since we are making four comparisons, the significance level is 
higher than that of each separate test. 


Analysis of categorical data 
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Figure 14.23. Minitab’s Nominal Logistic Regression dialog box. 


Nominal Logistic Regression: Response versus Code 
Response Information 


Variable Value Count 
Response Not Found 2:15: (Reference Event) 

Found, Unclear 18 

Found, incomplete 17 

Found, Failed 40 

Found and Worked 76 

Total 366 
Frequency: Number 
Logistic Regression Table 

Odds 95% CI 

Predictor Coef SE Coef Z PB Ratio Lower Upper 
Logit 1: (Found, Unclear/Not Found) 
Constant -2.5649 0.2878 -8.91 0.000 
Code 0.3457 0.5519 0.63 0.531 1.41 0.48 4.17 
Logit 2: (Found, incomplete/Not Found) 
Constant -2.8273 0.3254 -8.69 0.000 
Code 0.9446 0.5201 1.82 0.069 23:5 0.93 7s13 
Logit 3: (Found, Failed/Not Found) 
Constant -1.6959 0.1954 -8.68 0.000 
Code 0.0645 0.4136 0.16 0.876 1:..0'7 0.47 2.40 
Logit 4: (Found and Worked/Not Found) 
Constant =L2179 0.1610 -7.57 0.000 
Code 0.6473 0.2935 2.21 0.027 1.91 1.07 3.40 


Log-likelihood = -425.268 
Test that all slopes are zero: G = 7.053, DF = 4, P-Value = 0.133 


Figure 14.24. Minitab nominal logistic regression output. 
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Nominal Logistic Regression: Response versus Code 


Response Information 


Count 
215 (Reference 
Found, Onelear 18 
Found, 7 
Found, a 


Event) 


Found amd Vo 
otal 
ency: Number 


s¢ Pegressicn 


-8.91 0.000 
0.63 9.591 1a 0.4 


2: (Found, tmcouplece 
Constant “2.8273 0. 
Code 0. 9406 


000 


1.02 0.069 


Logit 9: (Found, Fatled/Not Found) 
Constant 1.6959 o. 4 8.68 0.000 
Code 0.0645 0.4136 0.36 0,876 1.07 1.47 


Logit 4: ¢ 


0.000 


Constant -9.57 
2.21 0.027 1.91 


Code 


$4 CI 


Interval includes 1, p-value > 
0.05. Le., “found but unclear” 
isn’t significantly different 
than the reference event. 


Upper a 
419 


i? 


“Found and worked” occurs 
2.40 significantly more often than 
the reference event. 


fee 


Log-iakelihood 
Test thet all slepes are cero: C = 7.053, DF = 


~425.260 


This is a “family” p-value 


Figure 14.25. Interpretation of Minitab nominal logistic regression output. 


Comparison with chi-square 

If a chi-square analysis is performed on the web redesign data Minitab pro- 
duces the output shown in Figure 14.26. Note that the chi-square procedure 
prints a warning that there are two cells with less than the recommended mini- 
mum expected frequency of 5.0. It also gives a P-value of 0.116, which is greater 
than the critical value of 0.05, leading to a somewhat different conclusion than 
the logistic regression analysis. The chi-square test only lets us look at the sig- 
nificance of the overall result, which is analogous to the “family P-value” test 
performed in the nominal logistic regression analysis. However, in this case we 
are primarily concerned with the improved odds of finding the correct answer 
with the new web design vs. the old web design, which is provided by logit 4 of 
the logistic regression. 


NON-PARAMETRIC METHODS 


The most commonly used statistical tests (t-tests, Z-tests, ANOVA, etc.) 
are based on a number of assumptions (see testing assumptions above). 
Non-parametric tests, while not assumption-free, make no assumption of a 
specific distribution for the population. The qualifiers (assuming...) for 
non-parametric tests are always much less restrictive than for their para- 
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Chi-Square Test: Before, After 


Expected counts are printed below observed counts 


Before After Total 
1 50 26 76 
56.69 19.31 


* aes ase ~~ | Chi-square only 
3 13 5 18 gives an overall 
13.43 4.57 
result 
4 31 9 40 


29.64 10.16 


5 1693 46 215 
160.37 54.63 


Total 273 93 366 
Family P-value > 
Chi-Sq = 0.789 + 2.317 + 0.05 
0.567 + 1.663 + 
0.014 + 0.040 + 
0.045 + 0.133 + ; 
0.465 + 1.364 $7396 Sample size 
DF = 4, P-Value = 0.116 too small. 


2 cells with expected counts less than 5.0 


Figure 14.26. Chi-square analysis of web design data. 


metric counterparts. For example, classical ANOVA requires the assump- 
tions of mutually independent random samples drawn from normal distribu- 
tions that have equal variances, while the non-parametric counterparts 
require only the assumption that the samples come from any identical con- 
tinuous distributions. Also, classical statistical methods are strictly valid 
only for data measured on interval or ratio scales, while non-parametric sta- 
tistics apply to frequency or count data and to data measured on nominal 
or ordinal scales. Since interval and ratio data can be transformed to nom- 
inal or ordinal data, non-parametric methods are valid in all cases where 
classical methods are valid; the reverse is not true. Ordinal and nominal 
data are very common in Six Sigma work. Nearly all customer and employee 
surveys, product quality ratings, and many other activities produce ordinal 
and nominal data. 
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So if non-parametric methods are so great, why do we ever use parametric 
methods? When the assumptions hold, parametric tests will provide greater 
power than non-parametric tests. That is, the probability of rejecting Hy when 
it is false is higher with parametric tests than with a non-parametric test using 
the same sample size. However, if the assumptions do not hold, then non- 
parametric tests may have considerably greater power than their parametric 
counterparts. 

It should be noted that non-parametric tests perform comparisons using 
medians rather than means, ranks rather than measurements, and signs of dif- 
ference rather than measured differences. In addition to not requiring any distri- 
butional assumptions, these statistics are also more robust to outliers and 
extreme values. 

The subject of non-parametric statistics is a big one and there are many entire 
books written about it. We can’t hope to cover the entire subject in a book 
about Six Sigma. Instead, we briefly describe the non-parametric tests per- 
formed by Minitab (Figure 14.27). Minitab’s non-parametric tests cover a rea- 
sonably wide range of applications to Six Sigma work, as shown in Table 14.9. 


Stat Graph Editor Window Heb 
Basic Statistics , 
Regression 
ANOVA U 
DOE , 
Control Charts » 
Quality Tools » 

Relabaty /Surviva U 

, 
, 
’ 
’ 


GJS SOE 


eh 


Mtv arte 
Time Senes 
Tabies 


Nonparametrics 
EDA » 1-Sample Wikoxon 
Power and Sample Sve» 
Mann whiney 
Kruska-W alls 
Mood's Median Test. 
Freaman 
Runs Test 


Parwise Averages 
Parwise Differences... 
Parwise Slopes 


Figure 14.27. Minitab’s non-parametric tests. 
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Table 14.9. Applications for Minitab’s non-parametric tests.* 


MINITAB NON- 
PARAMETRIC TEST 


WHAT IT DOES 


PARAMETRIC 
ANALOGS 


1-sample sign 


Performs a one-sample sign test of the 
median and calculates the 
corresponding point estimate and 
confidence interval. 


© 1-sample Z-test 
© 1-sample t-test 


1-sample Wilcoxon 


Performs a one-sample Wilcoxon 
signed rank test of the median and 
calculates the corresponding point 
estimate and confidence interval. 


© 1-sample Z-test 
© 1-sample t-test 


Mann-Whitney 


Performsa hypothesis test of the 
equality of two population medians and 
calculates the corresponding point 
estimate and confidence interval. 


© 2-sample t-test 


Kruskal-Wallis 


Mood’s median test 


Kruskal-Wallis performs a hypothesis 
test of the equality of population 
medians for a one-way design (two or 
more populations). This test is a 
generalization of the procedure used by 
the Mann-Whitney test. 


See also: Mood’s median test. 


Performs a hypothesis test of the 
equality of population medians ina 
one-way design. Sometimes called a 
median test or sign scores test. 


Mood’s median test is robust against 
outliers and errors in data, and is 
particularly appropriate in the 
preliminary stages of analysis. 


Mood’s median test is more robust 
against outliers than the Kruskal- 
Wallis test, but is less powerful (the 
confidence interval is wider, on the 
average) for analyzing data from 
many distributions, including data 
from the normal distribution. 


See also: Kruskal-Wallis test. 


Continued next page... 


© One-way ANOVA 


© One-way ANOVA 
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Table 14.9—Continued. 


MINITAB NON- 
PARAMETRIC TEST 


WHAT IT DOES 


PARAMETRIC 
ANALOGS 


Friedman 


Performs a non-parametric analysis of a 
randomized block experiment. 


Randomized block experiments are a 
generalization of paired experiments. 
The Friedman test is a generalization 
of the paired sign test witha null 
hypothesis of treatments having no 
effect. This test requires exactly one 
observation per treatment-block 
combination. 


© 2-way ANOVA 
O Paired sign test 


Runs tests 


Pairwise averages 


Test whether or not the data order is 
random. Use Minitab’s Stat > Quality 
Tools > Run Chart to generate a run 
chart. 


Pairwise averages calculates and stores 


the average for each possible pair of 
values in a single column, including 
each value with itself. Pairwise averages 
are also called Walsh averages. Pairwise 
averages are used, for example, for the 
Wilcoxon method. 


O None 


O None 


Pairwise differences 


Pairwise differences calculates and 
stores the differences between all 
possible pairs of values formed from 
two columns. These differences are 
useful for non-parametric tests and 
confidence intervals. For example, the 
point estimate given by Mann-Whitney 
can be computed as the median of the 
differences. 


O None 


Pairwise slopes 


Pairwise slopes calculates and stores 
the slope between all possible pairs of 
points, where a row in y-x columns 
defines a point in the plane. This 
procedure is useful for finding robust 
estimates of the slope of a line through 
the data. 


Continued next page... 


© Simple linear regression 
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Table 14.9—Continued. 


MINITAB NON- PARAMETRIC 
PARAMETRIC TEST | WHAT IT DOES ANALOGS 


Levene’s test 


Test for equal variances. This method O Bartlett’s test 
considers the distances of the 
observations from their sample median 
rather than their sample mean. Using 
the sample median rather than the 
sample mean makes the test more 


robust for smaller samples. 


Non-parametric Dist Analyzes times-to-failure when no © Parametric Dist 
Analysis—Censored distribution can be found to fit the Analysis—Censored 
Data (censored) data. Tests for the equality data 

of survival curves. 
Hazard plots—non- Ifdataare right censored, plotsempirical | © Hazard plots — 
parametric distribution | hazard function oractuarial estimates. parametric distribution 
analysis analysis. 


If data are arbitrarily censored, plots 
actuarial estimates. 


*© All Rights Reserved. 2000 Minitab, Inc. Used by permission. 


Guidelines on when to use non-parametric tests 


Use non-parametric analysis when any of the following are true (Gibbons, 


1993): 
1. 


Bs GN! 


The data are counts or frequencies of different types of outcomes. 

The data are measured on a nominal scale. 

The data are measured on an ordinal scale. 

The assumptions required for the validity of the corresponding para- 
metric procedure are not met or cannot be verified. 

The shape of the distribution from which the sample is drawn is unknown. 
The sample size is small. 

The measurements are imprecise. 

There are outliers and/or extreme values in the data, making the median 
more representative than the mean. 


Use a parametric procedure when both of the following are true: 


1. 


The data are collected and analyzed using an interval or ratio scale of 
measurement. 

All of the assumptions required for the validity of that parametric proce- 
dure can be verified. 
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CHAPTER 


Lo 


Managing Six Sigma 
Projects” 


The dictionary defines the word project as follows: 

1. Aplan or proposal; a scheme. See synonyms at plan. 

2. An undertaking requiring concerted effort. 

Under the synonym plan we find: 

1. Ascheme, program, or method worked out beforehand for the accom- 

plishment of an objective: a plan of attack. 

2. A proposed or tentative project or course of action. 

3. Asystematic arrangement of important parts. 

Although truly dramatic improvement in quality often requires transform- 
ing the management philosophy and organization culture, the fact is that, 
sooner or later, projects must be undertaken to make things happen. Projects 
are the means through which things are systematically changed, projects are 
the bridge between the planning and the doing. 

Frank Gryna makes the following observations about projects (Juran and 
Gryna, 1988, pp. 22.18—22.19): 

e An agreed-upon project is also a legitimate project. This legitimacy puts 

the project on the official priority list. It helps to secure the needed bud- 


*Some of the material in this chapter is from The Six Sigma Project Planner, by Thomas Pyzdek. © 2003 by McGraw-Hill. 


Copyright 2003 by The McGraw-Hill Companies, Inc. Click Here for Terms of Use. 
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gets, facilities, and personnel. It also helps those guiding the project to 
secure attendance at scheduled meetings, to acquire requested data, to 
secure permission to conduct experiments, etc. 

¢ The project provides a forum of converting an atmosphere of defensive- 
ness or blame into one of constructive action. 

e Participation in a project increases the likelihood that the participant will 
act on the findings. 

e All breakthrough is achieved project by project, and in no other way. 


The last item represents both good news and bad news. The bad news is that 
few projects are truly successful; the good news is that companies can and do 
become proficient at implementing projects without the need for mystical 
powers. What is needed is effective project management. 


USEFUL PROJECT MANAGEMENT TOOLS AND 
TECHNIQUES 


Project management is a system for planning and implementing change that 
will produce the desired result most efficiently. There are a number of tools 
and techniques that have been found useful in project management. Brief 
descriptions of the major project management methods are provided here. 
Techniques specific to project management are covered in greater detail else- 
where in this chapter. Many of these tools are used in a wide variety of quality 
improvement and quality control situations in addition to project management; 
additional information on each of these more general techniques is found else- 
where in this book; consult the index for details. 

Project plan—The project plan shows the “why” and the “how” of a project. 
A good project plan will include a statement of the goal, a cost/ benefit analysis, 
a feasibility analysis, a listing of the major steps to be taken, a timetable for com- 
pletion, and a description of the resources required (including human 
resources) to carry out the project. The plan will also identify objective mea- 
sures of success that will be used to evaluate the effectiveness of the proposed 
changes; these are sometimes called the “deliverables” of the project. 

Gantt chart—A Gantt chart shows the relationships among the project 
tasks, along with time constraints. See below for a discussion of Gantt charts. 

Milestone charts—A Gantt chart modified to provide additional informa- 
tion on project status. See below for a discussion of milestone charts. 

Pareto analysis—Pareto analysis is a technique that helps one to rank 
opportunities to determine which of many potential projects should be pursued 
first. It can also be used sequentially to determine which step to take next. The 


> 
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Pareto principle has been described by Juran as separating the “vital few” from 
the “trivial many.” It is the “why” and the “benefit” of the project plan. See 
Chapter 8 for additional discussion. 

Budget—A budget is an itemized summary of estimated or intended expen- 
ditures for a given project along with proposals for financing them. Project bud- 
gets present management with a systematic plan for the expenditure of the 
organization’s resources, such as money or time, during the course of the pro- 
ject. The resources spent include time of personnel, money, equipment utiliza- 
tion and so on. The budget is the “cost” portion of the project plan. Also see 
below. 

Process decision program chart (PDPC)—The PDPC technique is used to 
develop contingency plans. It is modeled after reliability engineering methods 
such as failure mode, effects, and criticality analysis (FMECA) and fault tree 
analysis (FTA). The emphasis of PDPC is the impact of problems on project 
plans. PDPCs are accompanied by specific actions to be taken should the pro- 
blems occur to mitigate the impact of the problems. PDPCs are useful in the 
planning of projects in developing a project plan with a minimum chance of 
encountering serious problems. Also see Chapter 8. 

Quality function deployment (QFD)—Traditionally, QFD is a system for 
design of a product or service based on customer demands, a system that 
moves methodically from customer requirements to requirements for the 
products or services. QFD provides the documentation for the decision-making 
process. QFD can also be used to show the “whats” and “hows” of a project. 
Used in this way QFD becomes a powerful project planning tool. Also see 
Chapter 3. 

Matrix chart—A matrix chart is a simplified application of QFD (or, per- 
haps, QED is an elaborate application of matrix charts). This chart is con- 
structed to systematically analyze the correlations between two groups of 
ideas. When applied to project management the two ideas might be, for example 
1) what is to be done? 2) who is to do it? Also see Chapter 8. 

Arrow diagrams—Arrow diagrams are simple network representations of 
project flows. They show which tasks must be completed in the project and 
the order in which the tasks must be completed. See Chapter 8. Arrow diagrams 
are a simplification of PERT-type systems (see below). 


PROJECT PLANNING 


There are several reasons why one should plan carefully before starting a 
project (Ruskin and Estes, 1995, p. 44): 
1. The plan is a simulation of prospective project work, which allows flaws 
to be identified in time to be corrected. 
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2. The plan is a vehicle for discussing each person’s role and responsibil- 
ities, thereby helping direct and control the work of the project. 
3. The plan shows how the parts fit together, which is essential for coordi- 
nating related activities. 
4. The planisa point of reference for any changes of scope, thereby helping 
project managers deal with their customers. 
5. The plan helps everyone know when the objectives have been reached 
and therefore when to stop. 
The project plan shows the “why” and the “how” of a project. A good project 
plan will include the following elements: 
* statement of the goal 
* cost/benefit analysis 
feasibility analysis 
listing of the major steps to be taken 
timetable for completion 
description of the resources required (including human resources) to 
carry out the project 
The plan will also identify objective measures of success that will be used to 
evaluate the effectiveness of the proposed changes; these are sometimes called 
the “deliverables” of the project. 


PROJECT DECOMPOSITION 


Most projects important enough to have a significant impact on quality 
are too large to tackle all at once. Instead, large projects must be broken 
down into smaller projects and, in turn, into specific work elements and 
tasks. The process of going from project objectives to tasks is called decom- 
position. Project decomposition begins with the preparation of a preliminary 
plan. A preliminary project plan will identify, in broad high-level terms, the 
objectives of the project and constraints in terms of time and resources. 
The work to be performed should be described and precedence relation- 
ships should be sketched out. Preliminary budgets and schedules will be 
developed. Finally, subplans will be developed for each subproject for the 
following: 

¢ Control plans 

— Quality control plans 
— Cost control plans 
— Schedule control plans 
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e Staffing plans 

e Material plans 

¢ Reporting plans 

¢ Other plans as deemed necessary 


These subplans are developed in parallel for the various subprojects. 


INTEGRATED QUALITY INITIATIVES 


Also see cross-functional collaboration, below. 

Projects should be selected consistent with the organization’s overall 
strategy and mission. Because of this global perspective most projects 
involve the efforts of several different functional areas. Not only do indivi- 
dual quality projects tend to cut across organizational boundaries, different 
projects are often related to one another. To effectively manage this com- 
plexity it is necessary to integrate the planning and execution of projects 
organization-wide. 

(For additional details on teams see Chapter 5.) 

Teams are chartered by senior leadership, generally the only group with the 
necessary authority to designate cross-functional responsibilities and allow 
access to interdepartmental resources. The team facilitator should ask senior 
leadership to put the problem statement in writing. The problem statement 
should be specific enough to help the team identify the scope of the project 
and the major stakeholders. Problems of gargantuan proportions should be sub- 
divided into smaller projects. 

There are six steps in the chartering process: 

1. Obtaining a problem statement 
Identifying the principal stakeholders 
Creating a macro flow chart of the process 
Selecting the team members 
Training the team 
Selecting the team leader 


nur wWN 


PROJECT CHARTER 


The official authorization for the project should be summarized in a docu- 
ment like that shown in the Six Sigma project charter below. 
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Six Sigma Project Charter. 


SIX SIGMA PROJECT CHARTER STATEMENT 
and STATUS SUMMARY 


Project Name/ 
Number 


Sponsoring Organization 


Key Leadership Name Phone Number | Mail Station 


Sponsor 


Project Black Belt 


Project Green Belt 


Team Members Title/Role Phone Number Mail Station 


Support Personnel 


Financial Adviser 


Key Stakeholders Title Phone Number | Mail Station 


Date Chartered Project Start Date Target Completion Date 


Revision Number: Date 


Sponsor Signature: 


Continued next page... 
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Project Name/Number 


Project Mission Statement 


Problem Statement (““What’s wrong with the status quo?”’) 


Business Need Addressed by Project (“What is the ‘Burning Platform’ for this project?”) 


Project Scope (Product or Service Created by this Project (Deliverables)) 


Resources Authorized for Project (include Charge Number) 


Six Sigma Phase Status (DMAIC projects) 


Target 
Six Sigma Stage | Summary Completion 


Define 


Status 


Measure 


Analyze 


Improve 


Control 


Project Completion Barriers Encountered (Top 3) 


Lessons Learned 
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Several problems with projects appear repeatedly: 

¢ Projects have little or no impact on the organization’s success, even if suc- 
cessful, no one will really care. 

¢ Missions overlap the missions of other teams. E.g., Team A’s mission is to 
reduce solder rejects, Team B’s mission is to reduce wave solder rejects, 
Team C’s mission is to reduce circuit board assembly problems. 

e Projects improve processes that are scheduled for extensive redesign or 
discontinuation. For example, working on improving work flow for a pro- 
duction process that is to be relocated to another factory. 

¢ Studying a huge system (“patient admitting”), rather than a manageable 
process (“outpatient surgery preadmission”’). 

¢ Studying symptoms (“touch-up of defective solder joints”) rather than 
root causes (“wave solder defects’’) 

e Project deliverables are undefined. E.g., “Study TQM” rather than 
“Reduce waiting time in Urgent Care.” 


WORK BREAKDOWN STRUCTURES 


Ruskin and Estes (1995) define work breakdown structures (WBS) as a pro- 
cess for defining the final and intermediate products of a project and their rela- 
tionships. Defining project tasks is typically complex and accomplished by a 
series of decompositions followed by a series of aggregations. For example, a 
software project to develop an SPC software application would disaggregate 
the customer requirements into very specific analytic requirements (e.g, the 
customer’s requirement that the product create X-bar charts would be decom- 
posed into analytic requirements such as subroutines for computing subgroup 
means and ranges, plotting data points, drawing lines, etc.). Aggregation would 
involve linking the various modules to produce an X-bar chart displayed on 
the screen. 

The WBS can be represented in a tree diagram, as shown in Figure 15.1. 

Preliminary requirements WBS—is a statement of the overall require- 
ments for the project as expressed by the customer (e.g., the deliverables or 
“product”), and subsidiary requirements as expressed by management (e.g,, 
billing, reports required). 

Detailed plan WBS—breaks down the product into subproducts. 
Requirements are listed for each subproduct (e.g., tooling, staff). The sub- 
products are, in turn, broken down into their subproducts, etc., until a rea- 
sonable limit is reached. All work begins at the lowest level. Detailed plans for 
each subsystem include control plans for quality, cost and schedule, staffing 
plans, materials plans, reporting plans, contingency plans, and work author- 
ization plans. In addition, the overall detailed plan covers objectives, con- 
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Attitude and Articutation 
Conirai Subsystem {AACS) 
Project Products 


| | | 


AACS Technical Administrative 
documentation reports 
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Accomplish- Resource 
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Figure 15.1. WBS of a spacecraft system. 
From Ruskin, A.M. and Estes, W.E. What Every Engineer Should Know About Project 
Management, Second Edition. Copyright © 1995 by Marcel Dekker, Inc. 
Reprinted with permission. 


straints, precedence relationships, timetables, budgets, and review and report- 
ing criteria. 

Typical subsystem WBS—are created, ie., the process just described is 
performed for each subsystem. Subsystems are then built. 

Integration WBS—detail how the various subsystems will be assembled 
into the product deliverables. This usually involves integrating into larger sub- 
systems, then still larger subsystems, etc., to the highest level of integration. 

Validation WBS—plans explain how the various system integrations will be 
measured and tested to assure that the final requirements will be met. 
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FEEDBACK LOOPS 


The project plan is itself an important feedback tool. It provides details on 
the tasks that are to be performed, when they are to be performed, and how 
much resource is to be consumed. The plan should also include explicit provi- 
sions for feedback. Typical forms of feedback are: 

¢ Status reports—Formal, periodic written reports, often with a standard- 
ized format, telling what the project is based on, and where it is supposed 
to be relative to the plan. Where project performance does not match 
planned performance, the reports include additional information as to 
the cause of the problem and what is being done to bring the project into 
alignment with the plan. Remedial action may, at times, involve revising 
the plan. When the project is not meeting the plan due to obstacles which 
the project team cannot overcome, the status report will request senior 
management intervention. 

e Management reviews—These are meetings, scheduled in advance, where 
the project leader will have the opportunity to interact with key members 
of the management team. The chief responsibility for these meetings is 
management’s. The purpose is to brief management on the status of the 
project, review the project charter and project team mission, discuss 
those management activities likely to have an impact on the progress of 
the team, etc. This is the appropriate forum for addressing systems bar- 
riers encountered by the team: while the team must work within existing 
systems, management has the authority to change the systems. At times a 
minor system change can dramatically enhance the ability of the team to 
progress. 

e Budget reviews—While budget reports are included in each status report, 
a budget review is a formal evaluation of actual resource utilization with 
respect to budgeted utilization. Budget review may also involve revising 
budgets, either upward or downward, based on developments since the 
original budget approval. Among those unschooled in the science of statis- 
tics there is an unfortunate tendency to react to every random tick in bud- 
get variances as if they were due to a special cause of variation. Six Sigma 
managers should coach finance and management personnel on the princi- 
ples of variation to preclude tampering with the budgeting process (also 
see below). 

¢ Customer audits—The “customer” in this context means the principal 
stakeholder in the project. This person is the “owner” of the process 
being modified by the project. The project deliverables are designed to 
meet the objectives of this customer, and the customer should play an 
active role in keeping the project on track to the stated goals. 
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¢ Updating plans and timetables—The purpose of feedback is to provide 
information to form a basis for modifying future behavior. Since that 
behavior is documented in the project plans and schedules, these docu- 
ments must be modified to ensure that the appropriate action is taken. 
Remember, in the PDCA cycle, plans change first. 

e Resource redirection—The modifications made to the plans and time- 
tables will result in increasing or decreasing resource allocation to the 
project, or accelerating or decelerating the timetable for resource 
utilization. The impact of these resource redirections on other projects 
should be evaluated by management in view of the organization’s overall 
objectives. 


PERFORMANCE MEASURES 


There are a wide variety of tools and techniques available to help the project 
manager develop a realistic project timetable, to use the timetable to time the 
allocation of resources, and to track progress during the implementation of the 
project plan. We will review two of the most common here: Gantt charts and 
PERT-type systems. 


Gantt charts 
Gantt chart—A Gantt chart shows the relationships among the project 
tasks, along with time constraints. The horizontal axis of a Gantt chart shows 
the units of time (days, weeks, months, etc.). The vertical axis shows the activ- 
ities to be completed. Bars show the estimated start time and duration of the 
various activities. Figure 15.2 illustrates a simple Gantt chart. 
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Figure 15.2. Gantt chart. 
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Milestone charts—Gantt charts are often modified in a variety of ways to 
provide additional information. One common variation is shown in Figure 
15.3. The milestone symbol represents an event rather than an activity; it does 
not consume time or resources. When Gantt charts are modified in this way 
they are sometimes called “milestone charts.” 
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Ss an 
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Figure 15.3. Enhanced Gantt chart (milestone chart). 


Gantt charts and milestone charts can be modified to show additional infor- 
mation, such as who is responsible for a task, why a task is behind schedule, 
remedial action planned or already taken, etc. 


Typical DMAIC project tasks and responsibilities 

Although every project is unique, most Six Sigma projects which use the 
DMAIC framework have many tasks in common, at least at a general level. 
Many people find it helpful if they have a generic “template” they can use to 
plan their project activities. This is especially true when the Black Belt or 
Green Belt is new and has limited project management experience. Table 15.1 
can be used as a planning tool by Six Sigma teams. It shows typical tasks, respon- 
sibilities and tools for each major phase of a typical Six Sigma project. 


PERT-CPM-type project management systems 
While useful, Gantt charts and their derivatives provide limited project sche- 
dule analysis capabilities. The successful management of large-scale projects 
requires more rigorous planning, scheduling and coordinating of numerous 
interrelated activities. To aid in these tasks, formal procedures based on the 


546 MANAGING Srx SIGMA PROJECTS 


Table 15.1. Typical DMAIC project tasks and responsibilities. 


TASK RESPONSIBILITY 


Charter Project 


Identify opportunity for improvement 


Black Belt 


Identify sponsor 


Black Belt 


Estimate savings 


Draft project charter 


Black Belt 


Black Belt, sponsor 


Sponsor project review (weekly) 


Sponsor, Black Belt 


Define 


Team selection 
Complete project charter 
Team training 


Review existing process documentation 


Sponsor, Black Belt 
Black Belt 


Black Belt, Green Belt 


Team member, process expert 


Define project objectives and plan 


Team 


Present objectives and plan to management 


Green Belt 


Define and map as-is process 


Team, process expert 


Review and re-define problem, if necessary Team 
Sponsor 
Measure 
Identify CTQs Green Belt, Black Belt 


Collect data on subtasks and cycle time 


Team 


Validate measurement system 


Black Belt, process operator 


Analyze 


Prepare baseline graphs on subtasks/cycle time 


Black Belt, Green Belt 


Analyze impacts, e.g., subtasks, Pareto... 


Black Belt, Green Belt 


Use subteams to analyze time and value, risk 
management 


Team 


Benchmark other companies 


Team member 


Continued next page... 
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Table 15.1—Continued. 


Discuss subteams’ preliminary findings 


Team 


Consolidate subteams’ analyses/findings 


Team 


Improve 


Present recommendations to process owners and 
operators 


Review recommendations/formulate pilot 


Sponsor, team 


Team, Black Belt 


Prepare for improved process pilot 


Team, process owner 


Test improved process (run pilot) 


Process operator 


Analyze pilot and results 


Black Belt, Green Belt 


Develop implementation plan 
Prepare final presentation 


Present final recommendations to management team 


Team, process owner 
Team 


Green Belt 


Control 


Define control metrics 


Black Belt, Green Belt, process 


expert 


Develop metrics collection tool 


Black Belt 


Roll-out improved process 


Process owner 


Roll-out control metrics 


Process owner 


Monitor process monthly using control metrics 


Process owner, Black Belt 


use of networks and network techniques were developed beginning in the late 
1950s. The most prominent of these procedures have been PERT (Program 
Evaluation and Review Technique) and CPM (Critical Path Method). The two 
approaches are usually referred to as PERT-type project management systems. 
The most important difference between PERT and CPM is that originally the 
time estimates for the activities were assumed deterministic in CPM and were 
probabilistic in PERT. Today, PERT and CPM actually comprise one tech- 


nique and the differences are mainly historical. 


Project scheduling by PERT-CPM consists of four basic phases: planning, 
scheduling, improvement, and controlling The planning phase involves break- 
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ing the project into distinct activities. The time estimates for these activities are 
then determined and a network (or arrow) diagram is constructed with each 
activity being represented by an arrow. 

PERT-type systems are used to: 

e Aid in planning and control of projects 

e Determine the feasibility of meeting specified deadlines 

e Identify the most likely bottlenecks in a project 

e Evaluate the effects of changes in the project requirements or schedule 

e Evaluate the effects of deviating from schedule 

e Evaluate the effect of diverting resources from the project, or redirecting 

additional resources to the project. 

The ultimate objective of the scheduling phase is to construct a time chart 
showing the start and finish times for each activity as well as its relationship 
to other activities in the project. The schedule must identify activities that are 
“critical” in the sense that they must be completed on time to keep the project 
on schedule. 

It is vital not to merely accept the schedule as a given. The information 
obtained in preparing the schedule can be used to improve the project schedule. 
Activities that the analysis indicates to be critical are candidates for improve- 
ment. Pareto analysis can be used to identify those critical elements that are 
most likely to lead to significant improvement in overall project completion 
time. Cost data can be used to supplement the time data, and the combined 
time/cost information analyzed using Pareto analysis. 

The final phase in PERT-CPM project management is project control. This 
includes the use of the network diagram and Gantt chart for making periodic 
progress assessments 


EXAMPLE OF PERT 


The following is based on an example from Hillier and Lieberman (1980). 
Let’s say that we wish to use PERT on a project for constructing a house. The 
activities involved, and their estimated completion times, are presented in 
Table 15.2. 

Now, it is important that certain of these activities be done in a particular 
order. For example, one cannot put on the roof until the walls are built. This is 
called a precedence relationship, i.e., the walls must precede the roof. The net- 
work diagram graphically displays the precedence relationships involved in con- 
structing a house. A PERT network for constructing a house is shown in 
Figure 15.4 (incidentally, the figure is also an arrow diagram). 
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Table 15.2. Activities involved in constructing a house. 


ACTIVITY TIME TO COMPLETE (DAYS) 
Excavate 2 
Foundation 4 
Rough wall 10 
Rough electrical work 7 
Rough exterior plumbing 4 
Rough interior plumbing 5 
Wall board 5 
Flooring 4 
Interior painting 5 
Interior fixtures 6 
Roof 6 
Exterior siding 7 
Exterior painting 9 
Exterior fixtures 2 


FINDING THE CRITICAL PATH 


There are two time-values of interest for each event: its earliest time of com- 
pletion and its latest time of completion. The earliest time for a given event is 
the estimated time at which the event will occur if the preceding activities are 
started as early as possible. The latest time for an event is the estimated time 
the event can occur without delaying the completion of the project beyond its 
earliest time. Earliest times of events are found by starting at the initial event 
and working forward, successively calculating the time at which each event 
will occur if each immediately preceding event occurs at its earliest time and 
each intervening activity uses only its estimated time. 

Slack time for an event is the difference between the latest and earliest times 
for a given event. Thus, assuming everything else remains on schedule, the 
slack for an event indicates how much delay in reaching the event can be tol- 
erated without delaying the project completion. 

Events and activities with slack times of zero are said to lie on the critical path 
for the project. A critical path for a project is defined as a path through the net- 
work such that the activities on this path have zero slack. All activities and 
events having zero slack must lie on a critical path, but no others can. Figure 
15.5 shows the activities on the critical path for the housing construction project 
as thick lines. 
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Excavate (2 days) 
Foundation (4 days) 


Rough wall (10 days) 


Rough Roof (6 days) 
electrical 
work 
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plumbing (4 days) 
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Rough interior Te & 
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i Wall board (8 days) 


Flooring Interior painting 
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{ Exterior fixtures (2 days) 


Dummy (0 days) 


Interior 
fixtures 
(6 days) 


Figure 15.4. Project network for constructing a house. 
Source: Based on Introduction to Operations Research, 3rd Edition, Hillier and Lieberman. 
Copyright © 1980 by Holden-Day, Inc., San Francisco, California. 


CONTROL AND PREVENTION OF SCHEDULE 
SLIPPAGE 


Project managers can use the network and the information obtained from the 
network analysis in a variety of ways to help them manage their projects. One 
way is, of course, to pay close attention to the activities that lie on the critical 
path. Any delay in these activities will result in a delay for the project. 
However, the manager should also consider assembling a team to review the 
network with an eye towards modifying the project plan to reduce the total 
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Figure 15.5. Critical path for house construction example. 


time needed to complete the project. The manager should also be aware that the 
network times are based on estimates. In fact, it is likely that the completion 
times will vary. When this occurs it often happens that a new critical path 
appears. Thus, the network should be viewed as a dynamic entity which should 
be revised as conditions change. 

Primary causes of slippage include poor planning and poor management of 
the project. Outside forces beyond the control of the project manager will 
often play a role. However, it isn’t enough to be able to simply identify “outside 
forces” as the cause and beg forgiveness. Astute project managers will anticipate 
as many such possibilities as possible and prepare contingency plans to deal 
with them. The PDPC technique is useful in this endeavor. Schedule slippage 
should also be addressed rigorously in the schedule control plan, which was 
mentioned earlier as a primary deliverable from the project planning process. 
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The control plan should make provision for reviews conducted at intervals fre- 
quent enough to assure that any unanticipated problems are identified before 
schedule slippage becomes a problem. 


Resources 
Resources are those assets of the firm, including the time of employees, that 
are used to accomplish the objectives of the project. The project manager should 
define, negotiate, and secure resource commitments for the personnel, equip- 
ment, facilities, and services needed for the project. Resource commitments 
should be as specific as possible. Generally, resource utilization is specified in 
the project budget (see below). 
The following items should be defined and negotiated: 
¢ What will be furnished? 
¢ By whom? 
e When? 
¢ How will it be delivered? 
¢ How much will it cost? 
—Who will pay? 
— When will payment be made? 


Resource conflicts 

Of course, there are always other opportunities for utilizing resources. On 
large projects, conflicts over resource allocation are inevitable. It is best if 
resource conflicts can be resolved between those managers directly involved. 
However, in some cases, resource conflicts must be addressed by higher levels 
of management. Senior managers should view resource conflicts as potential 
indications that the management system for allocating resources must be modi- 
fied or redesigned. Often, such conflicts create ill will among managers and 
lead to lack of support, or even active resistance to the project. Too many such 
conflicts can lead to resentment towards quality improvement efforts in gen- 
eral. 


Methodology 
COST CONSIDERATIONS IN PROJECT SCHEDULING 


Most project schedules can be compressed, if one is willing to pay the addi- 
tional costs. For the analysis here, costs are defined to include direct elements 
only. Indirect costs (administration, overhead, etc.) will be considered in the 
final analysis. Assume that a straight-line relationship exists between the cost 
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of performing an activity on a normal schedule, and the cost of performing the 
activity on a crash schedule. Also assume that there is a crash time beyond 
which no further time saving is possible, regardless of cost. Figure 15.6 illus- 
trates these concepts. 


CRASH POINT 


ACTIVITY 
COST 


NORMAL POINT 
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NORMAL = |g tee ee A oh se 
COST 


t 
CRASH NORMAL 
DURATION DURATION 


ACTIVITY DURATION 


Figure 15.6 Cost-time relationship for an activity. 


For a given activity the cost-per-unit-of-time saved is found as 


crash cost — normal cost 


: : (15.1) 
normal time — crash time 


When deciding which activity on the critical path to improve, one should 
begin with the activity that has the smallest cost-per-unit-of-time saved. The pro- 
ject manager should be aware that once an activity time has been reduced there 
may be a new critical path. If so, the analysis should proceed using the updated 
information, i.e., activities on the new critical path should be analyzed. 

The data for the house construction example are shown in Table 15.3, with 
additional data for costs and crash schedule times for each activity. 

Activities shown in bold are on the critical path; only critical path activities 
are being considered since only they can produce an improvement in overall 
project duration. Thus, the first activity to consider improving would be foun- 
dation work, which costs $800 per day saved on the schedule (identified with 


554 


MANAGING SIX SIGMA PROJECTS 


Table 15.3. Schedule costs for activities involved in constructing a house. 


Normal Schedule Crash Schedule 


ACTIVITY Time (days) Time (days) 


Excavate 


2 
Foundation 4 


Rough wall 10 


Rough electrical work 


Rough exterior plumbing 


Rough interior plumbing 


Wall board 


Flooring 


3 
6 
4 
3 
3 
3 
2 


Interior fixtures 


Roof 


Exterior siding 


Exterior painting 


Exterior fixtures 


7 
4 
5 
5 
4 
Interior painting 5 
6 
6 
7 
9 
2 
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an asterisk [*] in Table 15.3). If additional resources could be directed towards 
this activity it would produce the best “bang for the buck” in terms of reducing 
the total time of the project. Next, assuming the critical path doesn’t change, 
would be excavation, then exterior painting, etc. 

As activities are addressed one by one, the time it takes to complete the pro- 
ject will decline, while the direct costs of completing the project will increase. 
Figure 15.7 illustrates the cost-duration relationship graphically. 

Conversely, indirect costs such as overhead, etc., are expected to increase as 
projects take longer to complete. When the indirect costs are added to the direct 
costs, total costs will generally follow a pattern similar to that shown in Figure 
15.8. 

To optimize resource utilization, the project manager will seek to develop a 
project plan that produces the minimum cost schedule. Of course, the organ- 
ization will likely have multiple projects being conducted simultaneously, 
which places additional constraints on resource allocation. 
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Figure 15.7. Direct costs as a function of project duration. 
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Figure 15.8. Total costs as a function of project duration. 


OTHER PERFORMANCE MEASUREMENT 
METHODOLOGY 


Project information should be collected on an ongoing basis as the project 
progresses. Information obtained should be communicated in a timely fash- 
ion to interested parties and decision-makers. The people who receive the 
information can often help the project manager to maintain or recover the 
schedule. There are two types of communication involved: feedback and 
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feedforward. Feedback is historical in nature and includes such things as 
performance to schedule, cost variances (relative to the project budget), 
and quality variances (relative to the quality plan). The reader will recall 
that initial project planning called for special control plans in each of 
these three areas. Feedforward is oriented towards the future and is primar- 
ily concerned with heading off future variances in these three areas. 
Information reporting formats commonly fall into one of the following 
categories: 

¢ formal, written reports 

¢ informal reports and correspondence 

¢ presentations 

¢ meetings 

¢ guided tours of the project, when feasible 

* conversations 

The principles of effective communication should be kept constantly in 
mind. The choice of format for the communication should consider the nat- 
ure of the audience and their needs and the time and resources available. 
Audiences can be characterized along five dimensions (Ruskin and Estes, 
1995): 

1. Audience diversity 
Audience sophistication 
Audience familiarity with the subject matter 
Audience size and geographic location 
. Audience need to know 

The report or presentation should be planned to avoid wasting the time of the 
audience members, or the time of those preparing the report or presentation. 
Objectives should be stated and the steps necessary to meet the objectives 
should be clearly stated in the plan. It may help to consider the communication 
asa “lesson” and the plan as a “lesson plan.” Provision should be made for assur- 
ing that the objectives were, in fact, met. 

Project communication is a process and, like all processes, it can be 
improved. The tools of Six Sigma are designed for just this purpose. 
Measurements can be analyzed using the quality control tools described in 
Chapters 9 and 10 and used to improve the process of project management. 
The PDCA cycle also applies to project management. 


VRWN 


Relevant stakeholders 


Large quality improvement projects impact large numbers of people within 
the organization. Those impacted are known as “stakeholders” in the project. 
As far as is practicable, the interests of stakeholders should be aligned with the 
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objectives of the project. If this is not the case, when stakeholders act according 
to their own interests they will be acting to sabotage the project, intentionally 
or unintentionally. 

Identifying project stakeholders begins with obtaining a project charter. 
Once the project charter has been finalized, the project team should prepare a 
list of potential stakeholders and their roles. If the project will have significant 
impact on hourly employees, they should be involved as well. If the workers 
are unionized, the union should be informed. Sell all stakeholders on the merits 
of the project. People resist changes unless they see the value in them and the 
urgency to take action. Stakeholders must be identified and their needs analyzed 
so that an action plan can be created to meet the needs and gain commitment. 
To avoid problems, the project team must constantly communicate with the 
stakeholders. 

Stakeholder focus groups are a method that allows group members to 
evaluate the potential impact of a plan by identifying the stakeholders affected 
by or having influence over the project plan. The focus group approach is a 
highly structured method in which the project team first identifies the stake- 
holders and their assumptions, then brings those identified together to elicit 
their responses to the proposed project (see Chapter 3 for a discussion of the 
focus group technique). The team then rates these assumptions for impor- 
tance to the stakeholders and importance to the plan. A stakeholder satisfac- 
tion plan may be developed to assure the support of key individuals and 
groups. 

As soon as possible the project manager should arrange a short, informal 
meeting with all of these individuals identified as being impacted, including 
one executive who sits on the Six Sigma Council (but not the entire council). 
The project manager and process owner are letting the stakeholders know that 
a project is about to be undertaken in “their” area, with the permission and 
direction of the senior executives. This meeting also represents an informal 
invitation for the middle managers to challenge the decision to conduct the 
project. It is important to allow the managers about a week to attempt to reverse 
the leadership’s decision to pursue the project. If concrete information suggests 
that tampering or sabotage is occurring, the project manager or process owner 
should immediately bring it to the attention of the senior executives who 
approved the project charter. The senior leadership should resolve the issue 
promptly. 

If a week or so passes without clear opposition to the project, the project 
manager should proceed with the implementation of the project plan. Of 
course, the lines of communication should remain open throughout the imple- 
mentation of the project plan. 
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Budgeting 


In this section we will provide an overview of budgeting as it applies to pro- 
ject management. 

The project manager must know where he stands in terms of expenditures. 
Once he is informed that a given amount of future expense is allocated to him 
for a particular project, it is his job to run the project so that this allowance is 
not exceeded. The process of allocating resources to be expended in the future 
is called budgeting. Budgets should be viewed as forecasts of future events, in 
this case the events are expenditures. A listing of these expenditures, broken 
out into specific categories, is called the budget. 


TYPES OF PROJECT BUDGETS 


Ruskin and Estes (1995) list the following types of project-related budgets: 

Direct labor budgets are usually prepared for each work element in the pro- 
ject plan, then aggregated for the project as a whole. Control is usually main- 
tained at the work element level to assure the aggregate budget allowance is 
not exceeded. Budgets may be in terms of dollars or some other measure of 
value, such as direct labor hours expended. 

Support services budgets need to be prepared because, without budgets, sup- 
port services tend to charge based on actual costs, without allowances for errors, 
rework, etc. The discipline imposed by making budget estimates and being 
held to them often leads to improved efficiency and higher quality. 

Purchased items budgets cover purchased materials, equipment, and services. 
The budgets can be based on negotiated or market prices. The issues mentioned 
for support services also apply here. 


TYPES OF BUDGET REPORTS 


Budgets allocate resources to be used in the future. No one can predict the 
future with certainty. Thus, an important element in the budgeting process is 
tracking actual expenditures after the budgets have been prepared. The fol- 
lowing techniques are useful in monitoring actual expenditures versus budgeted 
expenditures. 

Expenditure reports which compare actual expenditures to budgeted expen- 
ditures are periodically submitted to the budget authority, e.g., finance, sponsor. 

Expenditure audits are conducted to verify that charges to the project are 
legitimate and that the work charged was actually performed. In most large 
organizations with multiple projects in work at any given time it is possible to 
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find projects being charged for work done on other projects, for work not yet 
done, etc. While these charges are often inadvertent, they must still be identified. 

Variance reporting compares actual expenditures directly to budgeted expen- 
ditures. The term “variance” is used here in the accounting sense, not the statis- 
tical sense. In accounting, a variance is simply a comparison of a planned 
amount with an actual amount. An accounting variance may or may not indi- 
cate a special cause of variation; statistical techniques are required to make this 
determination. The timing of variance reporting varies depending on the need 
for control. The timing of variance reports should be determined in advance 
and written into the project plan. 

Variance tables: Variance reports can appear in a variety of formats. Most 
common are simple tables that show the actual/budgeted/variances by budget 
item, overall for the current period, and cumulatively for the project. Since it is 
unlikely that variances will be zero, an allowance is usually made, e.g., 5% over 
or under is allowed without the need for explanations. For longer projects, 
historical data can be plotted on control charts and used to set allowances. 

Variance graphs: When only tables are used it is difficult to spot patterns. To 
remedy this tables are often supplemented with graphs. Graphs generally show 
the budget variances in a time-ordered sequence on a line chart. The allowance 
lines can be drawn on the graph to provide a visual guide to the eye. 


ANALYSIS OF BUDGET REPORTS 


The project manager should review the variance data for patterns which 
contain useful information. Ideally, the pattern will be a mixture of positive 
and negative but minor variances. Assuming that this pattern is accompanied 
by an on-schedule project, this indicates a reasonably good budget, ie., an 
accurate forecasting of expenditures. Variances should be evaluated separately 
for each type of budget (direct labor, materials, etc.). However, the variance 
report for the entire project is the primary source of information concerning 
the status of the project in terms of resource utilization. Reports are received 
and analyzed periodically. For most quality improvement projects, monthly 
or weekly reports are adequate. Budget variance analysis* should include the 
following: 

Trends: Occasional departures from budget are to be expected. Of greater 
concern is a pattern that indicates a fundamental problem with the budget. 
Trends are easier to detect from graphic reports. 


*This is not to be confused with the statistical technique Analysis of Variance (ANOVA). 
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Overspending: Since budgeted resources are generally scarce, overspending 
represents a serious threat to the project and, perhaps, to the organization itself. 
When a project overspends its budget, it depletes the resources available for 
other activities and projects. The project team and team leader and sponsors 
should design monitoring systems to detect and correct overspending before it 
threatens the project or the organization. Overspending is often a symptom of 
other problems with the project, e.g., paying extra in an attempt to “catch up” 
after falling behind schedule, additional expenses for rework, etc. 

Underspending is potentially as serious as overspending. If the project budget 
was prepared properly then the expenses reflect a given schedule and quality 
level. Underspending may reflect “cutting corners” or allowing suppliers an 
allowance for slower delivery. The reasons for any significant departure from 
the plan should be explained. 


PROJECT MANAGEMENT IMPLEMENTATION 


Management support and organizational 
roadblocks 


INTERNAL ROADBLOCKS 


Most organizations still have a hierarchical, command-and-control organi- 
zational structure, sometimes called “smoke stacks” or “silos.” The functional 
specialists in charge of each smoke stack tend to focus on optimizing their own 
functional area, often to the detriment of the organization as a whole. In addi- 
tion, the hierarchy gives these managers a monopoly on the authority to act on 
matters related to their functional specialty. The combined effect is both a 
desire to resist change and the authority to resist change, which often creates 
insurmountable roadblocks to quality improvement projects. 

It is important to realize that organizational rules are, by their nature, a bar- 
rier to change. The formal rules take the form of written standard operating pro- 
cedures (SOPs). The very purpose of SOPs is to standardize behavior. The 
quality profession has (in this author’s opinion) historically overemphasized 
formal documentation, and it continues to do so by advocating such approaches 
as ISO 9000 and ISO 14000. Formal rules are often responses to past problems 
and they often continue to exist long after the reason for their existence has 
passed. In an organization that is serious about its written rules even senior 
leaders find themselves helpless to act without submitting to a burdensome 
rule-changing process. The true power in such an organization is the bureau- 
cracy that controls the procedures. If the organization falls into the trap of creat- 
ing written rules for too many things, it can find itself moribund in a fast- 
changing external environment. This is a recipe for disaster. 
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Restrictive rules need not take the form of management limitations on itself, 
procedures that define hourly work in great detail also produce barriers, e.g., 
union work rules. Projects almost always require that work be done differently 
and such procedures prohibit such change. Organizations that tend to be exces- 
sive in SOPs also tend to be heavy on work rules. The combination is often 
deadly to quality improvement efforts. 

Organization structures preserve the status quo in other ways besides formal, 
written restrictions in the form of procedures and rules. Another effective 
method of limiting change is to require permission from various departments, 
committees, councils, boards, experts, etc. Even though the organization may 
not have a formal requirement, that “permission” be obtained, the effect may 
be the same, e.g., “You should run that past accounting” or “Ms. Reimer and 
Mr. Evans should be informed about this project.” When permission for vehicles 
for change (e.g., project budgets, plan approvals) is required from a group that 
meets infrequently it creates problems for project planners. Plans may be rushed 
so they can be presented at the next meeting, lest the project be delayed for 
months. Plans that need modifications may be put on hold until the next meeting, 
months away. Or, projects may miss the deadline and be put off indefinitely. 


EXTERNAL ROADBLOCKS 


Modern organizations do not exist as islands. Powerful external forces take 
an active interest in what happens within the organization. Government bod- 
ies have created a labyrinth of rules and regulations that the organization 
must negotiate to utilize its human resources without incurring penalties or 
sanctions. The restrictions placed on modern businesses by outside regulators 
are challenging to say the least. When research involves people, ethical and 
legal concerns sometimes require that external approvals be obtained. The 
approvals are contingent on such issues as informed consent, safety, cost and 
sO on. 

Many industries have “dedicated” agencies to deal with. For example, the 
pharmaceutical industry must deal with the Food and Drug Administration 
(FDA). These agencies must often be consulted before undertaking projects. 
For example, a new treatment protocol involving a new process for treatment 
of pregnant women prior to labor may involve using a drug in a new way (e.g., 
administered on an outpatient basis instead of on an inpatient basis). 

Many professionals face liability risks that are part of every decision. Often 
these fears create a “play it safe” mentality that acts as a barrier to change. The 
fear is even greater when the project involves new and untried practices and 


technology. 
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INDIVIDUAL BARRIERS TO CHANGE 


Perhaps the most significant change, and therefore the most difficult, is to 
change ourselves. It seems to be a part of human nature to resist changing one- 
self. By and large, we worked hard to get where we are, and our first impulse is 
to resist anything that threatens our current position. Forsha (1992) provides 
the process for personal change shown in Figure 15.9. 

The adjustment path results in preservation of the status quo. The action 
path results in change. The well-known PDCA cycle can be used once a com- 
mitment to action has been made by the individual. The goal of such change is 
continuous self-improvement. 

Within an organizational context, the individual’s reference group plays a 
part in personal resistance to change. A reference group is the aggregation of 
people a person thinks of when they use the word “we.” If “we”’ refers to the 
company, then the company is the individual’s reference group and he or she 


DENIAL 
ANGER 
NEGOTIATION 


ADJUSTMENT PATH ACTION PATH 


Figure 15.9. The process of personal change. 


From The Pursuit of Quality Through Personal Change, by H.I. Forsha. Copyright © 1992 


by ASQ Quality Press, Milwaukee, WI. Used by permission. 
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feels connected to the company’s success or failure. However, “we” might refer 
to the individual’s profession or trade group, e.g., “We doctors,” “We engi- 
neers,’ “We union members.” In this case the leaders shown on the formal orga- 
nization chart will have little influence on the individual’s attitude towards the 
success or failure of the project. When a project involves external reference 
groups with competing agendas, the task of building buy-in and consensus is 
daunting indeed. 


INEFFECTIVE MANAGEMENT SUPPORT STRATEGIES 


Strategy #£1: command people to act as you wish—With this approach the 
senior leadership simply commands people to act as the leaders wish. The impli- 
cation is that those who do not comply will be subjected to disciplinary action. 
People in less senior levels of an organization often have an inflated view of the 
value of raw power. The truth is that even senior leaders have limited power to 
rule by decree. Human beings by their nature tend to act according to their 
own best judgment. Thankfully, commanding that they do otherwise usually 
has little effect. The result of invoking authority is that the decision-maker 
must constantly try to divine what the leader wants them to do in a particular 
situation. This leads to stagnation and confusion as everyone waits on the 
leader. Another problem with commanding as a form of “leadership” is the 
simple communication problem. Under the best of circumstances people will 
often simply misinterpret the leadership’s commands. 

Strategy #2: change the rules by decree—When rules are changed by decree 
the result is again confusion. What are the rules today? What will they be tomor- 
row? This leads again to stagnation because people don’t have the ability to 
plan for the future. Although rules make it difficult to change, they also provide 
stability and structure that may serve some useful purpose. Arbitrarily changing 
the rules based on force (which is what “authority” comes down to) instead of 
a set of guiding principles does more harm than good. 

Strategy #£3: authorize circumventing of the rules—Here the rules are 
allowed to stand, but exceptions are made for the leader’s “pet projects.” The 
result is general disrespect for and disregard of the rules, and resentment of the 
people who are allowed to violate rules that bind everyone else. An improve- 
ment is to develop a formal method for circumventing the rules, e.g., deviation 
request procedures. While this is less arbitrary, it adds another layer of com- 
plexity and still doesn’t change the rules that are making change difficult in the 
first place. 

Strategy #£4: redirect resources to the project—Leaders may also use their 
command authority to redirect resources to the project. A better way is to devel- 
op a fair and easily understood system to assure that projects of strategic impor- 
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tance are adequately funded as a matter of policy. In our earlier discussion of 
project scheduling we discussed “crash scheduling” as a means of completing 
projects in a shorter time frame. However, the assumption was that the basis 
for the allocation was cost or some other objective measure of the organ- 
ization’s best interest. Here we are talking about political clout as the basis of 
the allocation. 


EFFECTIVE MANAGEMENT SUPPORT STRATEGIES 


Strategy #£1: transform the formal organization and the organization’s 
culture—By far the best solution to the problems posed by organizational road- 
block is to transform the organization to one where these roadblocks no longer 
exist. As discussed earlier, this process can’t be implemented by decree. As the 
leader helps project teams succeed, he will learn about the need for transforma- 
tion. Using his persuasive powers the leader-champion can undertake the excit- 
ing challenge of creating a culture that embraces change instead of fighting it. 

Strategy #2: mentoring—In Greek mythology, Mentor was an elderly man, 
the trusted counselor of Odysseus, and the guardian and teacher of his son 
Telemachus. Today the term, “mentor” is still used to describe a wise and 
trusted counselor or teacher. When this person occupies an important position 
in the organization’s hierarchy, he or she can be a powerful force for eliminating 
roadblocks. Modern organizations are complex and confusing. It is often diffi- 
cult to determine just where one must go to solve a problem or obtain a needed 
resource. The mentor can help guide the project manager through this maze by 
clarifying lines of authority. At the same time, the mentor’s senior position 
enables him to see the implications of complexity and to work to eliminate 
unnecessary rules and procedures. 

Strategy Ff 3: identify informal leaders and enlist their support—Because of 
their experience, mentors often know that the person whose support the project 
really needs is not the one occupying the relevant box on the organization 
chart. The mentor can direct the project leader to the person whose opinion 
really has influence. For example, a project may need the approval of, say, the 
vice-president of engineering. The engineering VP may be balking because his 
senior metallurgist hasn’t endorsed the project. 

Strategy #4: find legitimate ways around people, procedures, resource con- 
straints and other roadblocks—It may be possible to get approvals or resources 
through means not known to the project manager. Perhaps a minor change in 
the project plan can bypass a cumbersome procedure entirely. For example, 
adding an engineer to the team might automatically place the authority to 
approve process experiments within the team rather than in the hands of the 
engineering department. 
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Short-term (tactical) plans 

Conceptually, project plans are subsets of bigger plans, all of which are 
designed to carry out the organization’s mission. The project plan must be 
broken down further. The objective is to reach a level where projects are 
“tiny.” A tiny project is reached when it is possible to easily answer two ques- 
tions: 

1. Is the project complete? 

2. Is the project done correctly? 

For example, a software development team concluded that a tiny computer 
module had the following characteristics: 1) it implemented only one concept; 
2) it could be described in 6 lines or less of easily understood pseudo-code 
(English like descriptions of what the program would do); and 3) the program- 
ming would fit on a single sheet of paper. By looking at the completed program- 
ming for the module, the team felt that it could answer the two questions. 

On Six Sigma projects, tactical plans are created by developing work break- 
down structures. The process of creating work breakdown structures was dis- 
cussed above. Tactical planning takes place at the bottom-most level of the 
work breakdown structures. If the project team doesn’t agree that the bottom 
level is tiny, then additional work breakdown must take place. 

Creating WBS employs the tree diagram technique. Tree diagrams are 
described in Chapter 8. Tree diagrams are used to break down or stratify ideas 
in progressively greater detail. The objective is to partition a big idea or problem 
into its smaller components. By doing this, you will make the idea easier to 
understand, or the problem easier to solve. The basic idea behind this is that, at 
some level, a problem’s solution becomes relatively easy to find. This is the 
tiny level. Work takes place on the smallest elements in the tree diagram. 

Tactical plans are still project plans, albeit for tiny projects. As such, they 
should include all of the elements of any well-designed project plan. 

Contingency plans should be prepared to deal with unexpected but poten- 
tially damaging events. The process decision program chart (PDPC) is a useful 
tool for identifying possible events that might be encountered during the pro- 
ject. The emphasis of PDPC is the impact of the “failures” (problems) on pro- 
ject schedules. Also, PDPC seeks to describe specific actions to be taken to 
prevent the problems from occurring in the first place, and to mitigate the 
impact of the problems if they do occur. An enhancement to classical PDPC is 
to assign subjective probabilities to the various problems and to use these to 
help assign priorities. The amount of detail that should go into contingency 
plans is a judgment call. The project manager should consider both the seri- 
ousness of the potential problem and the likelihood of its occurring. See 
Chapter 8 for additional information on PDPC. 
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Cross-functional collaboration 


This section will address the impact of organizational structures on man- 
agement of Six Sigma projects. 

Six Sigma projects are process-oriented and most processes that have signifi- 
cant impact on quality cut across several different departments. Modern organi- 
zations, however, are hierarchical, ie, they are defined by superior/ 
subordinate relationships. These organizations tend to focus on specialized 
functions (e.g., accounting, engineering). But adding value for the customer 
requires that several different functions work together. The ideal solution is 
the transformation of the organization into a structure designed to produce 
value without the need for a hierarchical structure. However, until that is 
accomplished, Six Sigma project managers will need to deal with the conflicts 
inherent in doing cross-functional projects in a hierarchical environment. 

Project managers “borrow” people from many departments for their pro- 
jects, which creates matrix organizational structures. The essential feature of a 
matrix organization is that some people have two or more bosses or project 
customers. These people effectively report to multiple bosses, e.g., the project 
manager and their own boss. Ruskin and Estes refer to people with more than 
one boss as multi-bossed individuals, and their bosses and customers as multiple 
bosses. Somewhere in the organization is a common boss, who resolves conflicts 
between multiple bosses when they are unable to do so on their own. Of course, 
multiple bosses can prevent conflicts by cooperation and collaboration before 
problems arise. 

Often multi-bossed individuals are involved with several projects, further 
complicating the situation. Collaborative planning between the multiple bosses 
is necessary to determine how the time of multi-bossed individuals, and other 
resources, will be shared. Figure 15.10 illustrates the simplest multi-bossing 
structure where the multi-bossed individual has just two multiple bosses, and 
the common boss is directly above the multiple bosses on the organizational 
hierarchy. For additional discussion of more complex matrix structures see 
Ruskin and Estes (1995, pp. 169-182). 

The matrix structure raises a number of questions regarding project planning 
and coordination. What should be planned? Who should organize planning 
activities? Who should participate in the planning? These issues were addressed 
earlier in this chapter, especially in the section entitled “Relevant stakeholders.” 

Good communication is helpful in preventing problems. Perhaps the most 
important communication is frequent, informal updates of all interested parties 
by the project manager. More formal status reports should also be specified in 
the project plan and sent to people with an interest in the project. The project 
manager should determine who gets what information, which is often tricky 
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Figure 15.10. Multi-boss collaborative planning 


due to the multi-boss status of the project manager. Some managers may not 
want “too much” information about their department’s “business” shared 
with their peers from other areas. Other managers may be offended if they 
receive less information than everyone else. The project manager’s best diplo- 
matic skills may be required to find the right balance. 

Status reports invariably indicate that the project plan is less than perfect. 
The process by which the plans will be adjusted should be understood in 
advance. The process should specify who will be permitted to make adjust- 
ments, when the adjustments will be allowed and how much authority the 
bosses and project manager have in making adjustments. 

Negotiated agreements should be documented, while generating the mini- 
mum possible amount of additional red tape and paperwork. The documen- 
tation will save the project manager a great deal of time in resolving disputes 
down the road regarding who agreed to what. 


Continuous review and enhancement of quality 
process 


The project management system can be improved, just as any system can be 
improved. The Six Sigma Black Belt’s arsenal of tools and principles offer the 
means. Address ‘such issues as cycle time, supplier management, customer 
service, etc., just as you would for any other critical management system. 
Continuous improvement principles, tools, and techniques are described in 
detail in Chapter 8. 
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Projects have customers, usually internal. The techniques described in 
Chapter 3 can be used to evaluate the satisfaction of the customers whose 
needs are being addressed by the project. 

The records of the project provide the raw data for process improvement. 
These records, combined with customer satisfaction analysis, tell manage- 
ment where the project planning and implementation process can be 
improved. The project manager should include recommendations for process 
improvement in the final project report. Organizational management, in 
particular common bosses, should aggregate the recommendations from 
several projects to identify systemic problems. Project schedules and budgets 
should be compared to actual results to evaluate the accuracy of these fore- 
casts. The results can be analyzed using the techniques described in Chapters 
11-14. Where special causes of variation in the results are present, they should 
be identified and corrected quickly. Common causes of variation indicate 
systemic problems. 


Documentation and procedures 


Project records provide information that is useful both while the project is 
underway, and afterwards. Project records serve three basic purposes: 

® cost accounting requirements 

¢ legal requirements 

e learning 

Project records should be organized and maintained as if they were part of a 
single database, even if it isn’t possible to keep all of the records in a single 
location. There should be one “official” copy of the documentation, and a 
person designated to act as the caretaker of this information while the project 
is active. Upon completion of the project, the documentation should be sent 
to the organization’s archives. Large quality improvement projects are expen- 
sive, time-consuming undertakings. The process involved is complex and 
often confusing. However, a great deal can be learned from studying the 
“project process.” To do this requires that there be data. Archives of a number 
of projects can be used to identify common problems and patterns between 
the various projects. For example, project schedules may be consistently too 
optimistic or too pessimistic. 

The following records should be kept: 

¢ statement of work 

e plans and schedules for projects and subprojects 

* correspondence (written and electronic) 

¢ written agreements 
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¢ meeting minutes 

¢ action items and responsibilities 

¢ budgets and financial reports 

* cost-benefit analyses 

* status reports 

* presentation materials 

¢ documentation of changes made to plans and budgets 

¢ procedures followed or developed 

¢ notes of significant lessons learned 

It is good practice for the project team to have a final meeting to perform a 
“post mortem” of the project. The meeting should be conducted soon after the 
project’s completion, while memories are still fresh. The meeting will cover 
the lessons learned from conducting the project, and recommendations for 
improving the process. The minutes from these meetings should be used to edu- 
cate project managers. 

The author believes that former guidelines for record retention are now 
outdated. In the past, record storage involved warehousing costs, insurance, 
aging of the paper, protecting the records from damage, etc. Furthermore, 
using the records required that one sift through endless boxes of disorganized 
material thrown in haphazardly. Today it is possible to reduce mountains of 
paper to electronic form. Low-cost software can automatically catalog the 
information and provide the ability to search the entire database quickly and 
easily. There seems to be little reason not to store complete project infor- 
mation indefinitely. 


FORMAL VERSUS INFORMAL REPORTS 


When people speak of “reports,” they usually mean formal written reports 
or, perhaps, formal verbal presentations. These forms of communication have 
certain advantages. They are relatively self-contained and complete and thus 
useful to personnel not intimately involved with the project. Their form lends 
itself to long-term retention. They usually include additional background 
materials. Finally, formal written reports are usually designed to address the 
concerns of all parties. However, formal written reports also have some 
drawbacks. Their preparation takes considerable time and effort, which makes 
them costly. Also, by trying to address everyone’s concern the formal written 
report usually contains a lot of information that is of little interest to the 
majority of the recipients. Of course, this latter drawback can be mitigated by 
creating a good table of contents and index and by carefully organizing the 
material. 


570 MANAGING SIx SIGMA PROJECTS 


Informal reports and correspondence are used to keep everyone up to date 
on the project. Unlike formal reports, this form of communication generally 
addresses a specific issue involving both the sender and the receiver. Because 
the parties to the communication usually bring a great deal of background 
information to the communication, informal reports tend to do poorly as 
stand-alone documents. However, informal reports can be prepared quickly 
and inexpensively and they tend to be short. 
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Risk Assessment 


RELIABILITY AND SAFETY ANALYSIS 
Reliability analysis 
BASIC RELIABILITY TERMS AND PRINCIPLES 


Safety and reliability are specialties in their own right. The Six Sigma analyst 
is expected to have an understanding of certain key concepts in these subject 
areas. It is obvious that these two areas overlap the Six Sigma body of knowledge 
to a considerable extent. Some concept areas are nearly identical (e.g., traceabil- 
ity) while others are merely complementary (e.g,, reliability presumes confor- 
mance to design criteria, which Six Sigma addresses directly). Modern ideas 
concerning safety share a common theoretical base with reliability.” 

While common usage of the term reliability varies, its technical meaning is 
quite clear: reliability is defined as the probability that a product or system 
will perform a specified function for a specified time without failure. For 
the reliability figure to be meaningful, the operating conditions must be care- 
fully and completely defined. Although reliability analysis can be applied to 
just about any product or system, in practice it is normally applied only 
to complex products. Formal reliability analysis is routinely used for both 
commercial products, such as automobiles, as well as military products such 
as missiles. 


*Some of the material in this section first appeared in The Complete Guide to the CRE by Bryan Dodson, © Quality 
Publishing. 


Copyright 2003 by The McGraw-Hill Companies, Inc. Click Here for Terms of Use. 
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Reliability terms 

MTBF—Mean time between failures, j4. When applied to repairable prod- 
ucts, this is the average time a system will operate until the next failure. 

Failure rate—The number of failures per unit of stress. The stress can be 
time (e.g., machine failures per shift), load cycles (e.g., wing fractures 
per 100,000 deflections of six inches), impacts (e.g., ceramic cracks per 
1,000 shocks of 5 g’s each), or a variety of other stresses. The failure 
rateA = 1/p. 

MTTF or MTFF—The mean time to first failure. This is the measure 
applied to systems that can’t be repaired during their mission. For 
example, the MTBF would be irrelevant to the Voyager spacecraft. 

MTTR—Mean time to repair. The average elapsed time between a unit fail- 
ing and its being repaired and returned to service. 

Availability—The proportion of time a system is operable. Only relevant for 
systems that can be repaired. Availability is given by the equation 


MTBF 
MTBF+MTTR 


Availability = (16.1) 


bio life" —The life value at which 10% of the population has failed. 

Dso life—The life value at which 50% of the population has failed. Also called 
the median life. 

Fault tree analysis (FTA)—Faulkt trees are diagrams used to trace symptoms 
to their root causes. Fault tree analysis is the term used to describe the 
process involved in constructing a fault tree. (See below for additional 
discussion.) 

Derating—Assigning a product to an application that is at a stress level less 
than the rated stress level for the product. This is analogous to pro- 
viding a safety factor. 

Censored test—A life test where some units are removed before the end of 
the test period, even though they have not failed. 

Maintainability—A measure of the ability to place a system that has failed 
back in service. Figures of merit include availability and mean time to 
repair. 


*bio life and bso life are terms commonly applied to the reliability of ball bearings. 
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TYPES OF RELIABILITY SYSTEMS 


The reliability of a given system is dependent on the reliability of its indi- 
vidual elements combined with how the elements are arranged. For example, a 
set of Christmas tree lights might be configured so that the entire set will fail if 
a single light goes out. Or it may be configured so that the failure of a single 
light will not affect any of the other lights (question: do we define such a set as 
having failed if only one light goes out? If all but one go out? Or some number 
in between?). 


Mathematical models 

The mathematics of reliability analysis is a subject unto itself. Most systems 
of practical size require the use of high speed computers for reliability evalua- 
tion. However, an introduction to the simpler reliability models is extremely 
helpful in understanding the concepts involved in reliability analysis. 

One statistical distribution that is very useful in reliability analysis is the 
exponential distribution, which is given by Equation 16.12. 


t 
R= exp(- rt >0 (16.2) 
a 


In Equation 16.2 Ris the system reliability, given as a probability, fis the time the 
system is required to operate without failure, jz is the mean time to failure for 
the system. The exponential distribution applies to systems operating in the con- 
stant failure rate region, which is where most systems are designed to operate. 


Reliability apportionment 

Since reliability analysis is commonly applied to complex systems, it is 
logical that most of these systems are composed of smaller subsystems. 
Apportionment is the process involved in allocating reliability objectives 
among separate elements of a system. The final system must meet the overall 
reliability goal. Apportionment is something of a hybrid of project management 
and engineering disciplines. 

The process of apportionment can be simplified if we assume that the expo- 
nential distribution is a valid model. This is because the exponential distribution 
hasa property that allows the system failure rate to be computedas the reciprocal 
of the sum of the failure rates of the individual subsystems. Table 16.1 shows the 
apportionment for a home entertainment center. The complete system is com- 
posed of a tape deck, television, compact disk unit, and a phonograph. Assume 
that the overall objective is a reliability of 95% at 500 hours of operation. 
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Table 16.1. Reliability apportionment for a home entertainment system. 


FAILURE 
SUBSYSTEM | RELIABILITY | UNRELIABILITY RATE OBJECTIVE 
Tape deck 0.990 0.010 0.00002 49,750 
Television 0.990 0.010 0.00002 49,750 
Compact disk 0.985 0.015 0.00003 33,083 
Phonograph 0.985 0.015 0.00003 33,083 
0.950 0.050 
TAPE DECK SUBSYSTEM 
FAILURE 
SUBSYSTEM |RELIABILITY | UNRELIABILITY RATE OBJECTIVE 
Drive 0.993 0.007 0.000014 71,178 
Electronics 0.997 0.003 0.000006 166,417 
0.990 0.010 


The apportionment could continue even further; for example, we could 
apportion the drive reliability to pulley, engagement head, belt, capstan, etc. 
The process ends when it has reached a practical limit. The column labeled 
“objective” gives the minimum acceptable mean time between failures for 
each subsystem in hours. MTBFs below this will cause the entire system to fail 
its reliability objective. Note that the required MTBFs are huge compared to 
the overall objective of 500 hours for the system as a whole. This happens partly 
because of the fact that the reliability of the system as a whole is the product of 
the subsystem reliabilities which requires the subsystems to have much higher 
reliabilities than the complete system. 

Reliability apportionment is very helpful in identifying design weaknesses. It 
is also an eye opener for management, vendors, customers, and others to see 
how the design of an entire system can be dramatically affected by one or two 
unreliable elements. 


Series 
A system is in series if all of the individual elements must function for the sys- 
tem to function. A series system block diagram is shown in Figure 16.1. 
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Figure 16.1. A series configuration. 


In Figure 16.1, the system is composed of two subsystems, A and B. Both A 
and B must function correctly for the system to function correctly. The reliabil- 
ity of this system is equal to the product of the reliabilities of A and B, in other 
words 


For example, if the reliability of A is 0.99 and the reliability of B is 0.92, then 
Rs = 0.99 x 0.92 = 0.9108. Note that with this configuration, Rs is always 
less than the minimum of Ra or Rg, This implies that the best way to improve 
the reliability of the system is to work on the system component that has the 
lowest reliability. 


Parallel 


A parallel system block diagram is illustrated in Figure 16.2. This system will 
function as long as A or Bor C haven't failed. The reliability of this type of con- 
figuration is computed using Equation 16.4. 


Rs =1—(1—R,) — Rg) — Rc) (16.4) 


For example, if Ra = 0.90, Rg = 0.95, and Rc = 0.93 then Rs = 1 — (0.1 
0.05 x 0.07) = 1 — 0.00035 = 0.99965. 

With parallel configurations, the system reliability is always better than the 
best subsystem reliability. Thus, when trying to improve the reliability of a par- 
allel system you should first try to improve the reliability of the best component. 
This is precisely opposite of the approach taken to improve the reliability of 
series configurations. 
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SUBSYSTEM 
A 


SUBSYSTEM 
B 


SUBSYSTEM 
Cc 


Figure 16.2. A parallel system. 


ASSESSING DESIGN RELIABILITY 


Seven steps in predicting design reliability 


1. 


Define the product and its functional operation. Use functional block 
diagrams to describe the systems. Define failure and success in unam- 
biguous terms. 

Use reliability block diagrams to describe the relationships of the var- 
ious system elements (e.g, series, parallel, etc.). 

Develop a reliability model of the system. 

Collect part and subsystem reliability data. Some of the information may 
be available from existing data sources. Special tests may be required to 
acquire other information. 

Adjust data to fit the special operating conditions of your system. Use 
care to assure that your “adjustments” have a scientific basis and are 
not merely reflections of personal opinions. 

Predict reliability using mathematical models. Computer simulation 
may also be required. 

Verify your prediction with field data Modify your models and predic- 
tions accordingly. 
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System effectiveness 

The effectiveness of a system is a broader measure of performance than 
simple reliability There are three elements involved in system effectiveness: 

1. Availability. 

2. Reliability. 

3. Design capability, i.e., assuming the design functions, does it also achieve 

the desired result? 
System effectiveness can be measured with Equation 16.5. 


Popp = Pa X PR X Pe (16.5) 


In this equation, Psp is the probability the system will be effective, P, is the 
availability as computed with Equation 16.1, Pz is the system reliability, and 
Pc is the probability that the design will achieve its objective. 


MONTE CARLO SIMULATION 


As seen in the previous sections, reliability modeling can be difficult math- 
ematically. And in many cases, it is impossible to mathematically model the 
situation desired. Monte Carlo simulation is a useful tool under these and 
many other circumstances, such as: 

¢ Verifying analytical solutions 

e Studying dynamic situations 

e Gaining information about event sequences; often expected values and 

moments do not provide enough detail 

e Determining the important components and variables in a complex sys- 

tem 

e Determining the interaction among variables 

e Studying the effects of changes without the risk, cost, and time constraints 

of experimenting on the real system 

e Teaching 


Random number generators 

The heart of any simulation is the generation of random numbers. If a pro- 
gramming language such as BASIC, C, or FORTRAN is used, random number 
generators will have to be created. If simulation languages such as Siman, 
Slam, Simscript, or GPSS are used, random number generators are part of the 
software. 

Random numbers from specific distributions are generated by transforming 
random numbers from the unit, uniform distribution. Virtually all pro- 
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gramming languages, as well as electronic spreadsheets, include a unit, uniform 
random number generator.” Technically, these unit, uniform random number 
generators are pseudo-random number generators, as the algorithms used to 
generate them take away a small portion of the randomness. Nevertheless, 
these algorithms are extremely efficient and for all practical purposes the result 
is a set of truly random numbers. 

A simple way to generate distribution-specific random numbers is to set the 
cumulative distribution function equal to a unit, random number and take the 
inverse. Consider the exponential distribution 


Ax 


F(x) =1—e7 (16.6) 


By setting r, a random variable uniformly distributed from zero to one, equal to 
F(x) and inverting the function, an exponentially distributed random variable, 
x, with a failure rate of 4 is created. 


r=1—-e” 
l-r=e” 
In(1 —r) = —Ax (16.7) 
In(1 —7r) 
ae 


This expression can be further reduced; the term 1 — r is also uniformly dis- 
tributed from zero to one. The result is 


I 
ea a (16.8) 


Table 16.2 contains some common random number generators. 


Simulation modeling 

After the desired random number generator(s) have been constructed, the 
next step is to mathematically model the situation under study. After com- 
pleting the model, it is important to validate and verify the model. A valid 


*A unit, uniform random variable can be generated using the “RND” function in the BASIC programming language (Visual 
Basic, Quick Basic, GWBasic, and BASICA), and the “@RAND” function in Lotus!™ 123. Microsoft!™ Excel includes a 


random generating tool that allows random numbers to be generated from several distributions. 
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Table 16.2 Random number generators. 


PROBABILITY DENSITY RANDOM 
DISTRIBUTION FUNCTION NUMBER GENERATORS 
Uniform fe) =— cy Seeeey x =a+(b—a)r 
—a 
Exponential Ax _ 1 
P I (x) = re ,0<x<c hos ley 
Normal 4a\= exp| 1 ( 7 “| x, = [/—2Inr, cos (2mr,)lo + 
a/ 2 + 
a x) = [/—2In7, sin(277r.)Jo + pe | 
-—-wo<x< © 
Lognormal wey P| 1 (=: - “) x, = exp[./—2Inr, cos (2mr,)]o + wu 
v2 : - x, = [./—2Inr, sin(27r,)lo + uw t 
x>0 
Weibull Pt x\ B 1 
f(x) = op XP () S10 x = 6(—Inr)'/? 
Poisson e“(Aty" 0, — ene >t} 
f(®) =f 8 = 1, 2,.-., 00 ame 
x= x+1 
5 lny <t< ru 
i- 1 v/2-1) —x 7 
Chrsquare f(x) = PTD bale i ae z;  z; is a standard normal 
i=l random deviate. 
Beta (x) = - rile 
f ce q) ~ pllp 4 yl/a 
iil ae 
Gamma rice ee” 1. 7 is a non-integer shape parameter. 
ta a , 2. Let n, =the truncated integer root 
x 20,120,420 of 7. mh 


j= 
4.LetA = n—7,andB=1-—A. 
5. Generate a random number and let 


1/A 
Ma 
6. Geneiate a random number and let 
_ ,1/B 
V2 = 4a: 


7. Ify,; +92 < 1goto9. 


8. Leti =i + 2and goto5. 
9.Letz = 91/01 +92). 
10. Generate a random number, r,,. 
11. Let W = —Inyr,,. 
12.x=(¢+zW)a. 


Continued on next page... 
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Table 16.2—Continued 


PROBABILITY DENSITY RANDOM 
DISTRIBUTION FUNCTION NUMBER GENERATORS 
ae px) = (n/p — p92 = 01-2] r= Sy, ye LO" e? 
= a : 1,r,<p 
Geometric pix) = pl Sy ae Ber ea ee In =) See In(t—) 44 t 
In (1 —p) In (1 —p) 
Student’st fe) = Tw + 1)/2] ee x =e Dia = — z; is a standard 
iia T(v/2)./7v v ‘ (= 2) normal random 
i=2 U deviate. 


-—-wOoO<x< © 


T[(v, + v)/2](v,/v,)"”” 2% 
f(x) = [( 1 2)/ a 1/ 2) b yi 
P/F 2/2 y 
»/2-1 x=— 7, wisa standard 
x 1 Bi 
ao ,x>0. Di ree normal random 
( + v1x/0)! ih: sm) i=v,+1 deviate: 


Two uniform random numbers must be generated, with the result being two normally distributed random numbers. 


*Increase the value of X until the inequality is satisfied. 


Sstatistical Software, such as MINITAB, have these functions built-in. 


model is a reasonable representation of the situation being studied A model is 
verified by determining that the mathematical and computer model created 
represents the intended conceptual model. 

Enough iterations should be included in the simulation to provide a steady- 
state solution, which is reached when the output of the simulation from one 
iteration to the next changes negligibly. When calculating means and variances, 
1,000 iterations is usually sufficient. If calculating confidence limits, many 
more iterations are required; after all, for 99% confidence limits the sample 
size for the number of random deviates exceeding the confidence limit is 
1/100th the number of iterations. 

Simulation can be used to determine the result of transformations of ran- 
dom variables. Suppose the mean and variance of the product of two normally 
distributed variables are needed for design purposes. The following BASIC 
code will produce the desired result. A flow chart for this code is shown in 
Figure 16.3. 
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Generate two normal 
random numbers 


Multiply the two 
numbers 


Add the result to 


a running sum 


Add the square of the 
result to a running sum 


Yes 


Calculate the mean 
and variance 


Figure 16.3. Flow chart for the simulation of two normally distributed normal variables. 


REM simulation for the product of two normally 
distributed variables 


e1=100 

vil=7 

e2=120 

v2=16 

DEFINT I-L 

FOR i = 1 TO 5000 

a = RND 

b = RND 

REM x is normal with mean=el and standard deviation=v1 

x= (((-2* LOG(a)) * .5) * COS(2* 3.141592654#* b)) *v1l+el REMy 


is normal with mean=e2 and standard deviation=v2 
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y= (((-2* LOG(a)) * .5) * SIN(2 * 3.141592654# * b)) *v2 + e2 
Z=x"*y 

ztot# = ztot# +z 

zsq# = zsq#+z% 2 

PRINT i 

NEXT i 

PRINT “‘ztot zsq”’; ztot#; zsq# 

PRINT ‘‘mean=""; ztot# / 5000 

zvar# = (5000 * zsq# - ztot# * 2) / (5000 * 4999) 

PRINT ‘‘variance="; zvar# 


Note: “RND” generates uniform random deviates on the interval from zero 
to one. The “LOG” function in BASIC represents the natural logarithm. 

In the above code, two normal random numbers are generated with the 
desired parameters and multiplied. This is repeated 5,000 times, and the mean 
and variance of these 5,000 random deviates are calculated. The result is a ran- 
dom variable with a mean of 12,009 and a variance of 3,307,380. 

For the above example, recall that the same result could have been obtained 
mathematically. A disadvantage of solving this problem mathematically is that 
there is no information regarding the shape of the resulting distribution. 

With electronic spreadsheets, simulations no longer require computer code. 
The previous example is simulated using Lotus 123'™ with the following steps.” 

1. IncellA7Z place the function @RAND 

2. IncellA2 place the function @RAND 

3. IncellA3 place the formula 

(((—2* @In(A1))* .5)* @cos(2* @pi* A2))*7+100 
4. IncellA4 place the formula 
(((—2* @In(A1))* —.5))* @cos(2* @ pi* A2))*7+100 
5. IncellA5 place the formula 
+A3"A4 
6. Copy the contents of row A 5,000 times 


In the above example, each row in the spreadsheet represents an iteration. 
The powerful @ functions and graphics tools contained in the spreadsheet 
can then be used for analysis. Note that each change in the spreadsheet causes 
the random numbers to be changed. It may be helpful to convert the output 
from formulas to fixed numbers with the “Range Value” command. 

Now consider a system consisting of four identical components which are 
exponentially distributed with a failure rate of 0.8. Three of the components 


Aa T™ : ; 
*Microsoft © Excel can generate normal random variables directly. 
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are standby redundant with perfect switching. Information is needed regarding 
the shape of the resulting distribution. The following code produces four expo- 
nentially distributed random variables with a failure rate of 0.8, adds them, and 
writes the result to the file “c:\data”; this process is repeated 5,000 times. A 
flow chart for this problem is provided in Figure 16.4. 


Open data file 
for output 


! 


Generate four exponential 
random numbers 


Sum the four 
random numbers 


Write the result 
to the output file 


Yes 


END 


Figure 16.4. Simulation for the sum of exponential random variables. 


REM simulation for the sum of four exponentially 
distributed variables 

DEFINT I-L 

OPEN ‘‘c:\data"’ FOR OUTPUT AS #1 LEN = 256 

FOR i = 1 TO 5000 

REM x1 is exponential with failure rate =0.8 

x1 =-(1/.8) * LOG(RND) 
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REM x2 is exponential with failure rate =0.8 
x2 = -(1/.8) * LOG(RND) 
REM x3 is exponential with failure rate =0.8 
x3 =-(1/.8) * LOG(RND) 
REM x4 is exponential with failure rate =0.8 
x4 =-(1/.8) * LOG(RND) 
y=xl+x2+x3+x4 
PRINT #1, USING “########4# . ##4H#": y 
PRINT i 

NEXT i 

CLOSE 


By importing the resulting data into an electronic spreadsheet or statistical 
program, a wide variety of analyses can be done on the data. A histogram of 
the data produced from the above code is shown in Figure 16.5. 


400 
300 


200: 


Frequency 


100 


Figure 16.5. Histogram of the sum of four exponentially distributed random variables. 


As seen from Figure 16.5, the sum of exponentially distributed random vari- 
ables with a failure rate of J is a random variable that follows the gamma distri- 
bution with parameters 7 = 7 and A. 

This problem is also easily simulated using an electronic spreadsheet. The 
steps required follow: 
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1. IncellsA7/throughA 4, place the formula 
—(1, 0.8)* @In(@rand) 
2. IncellA5 place the formula 
@sum(A1.. .A4) 

3. Copy the contents of row A 5,000 times 

Again, each row represents an iteration, and the spreadsheet can be used to 
obtain the desired simulation output. 

Now consider a system consisting of three components in series. The compo- 
nents are Weibully distributed with parameters B = 2, 0 = 300; B= 4, 
@ = 100; and, B = 0.5, 8 = 200. The code below depicts this situation. Figure 
16.6 shows a flow chart for this simulation. 


Open data file 
for output 


! 


Generate three Weibull 
random numbers 


Choose the minimum 


of the random numbers 


Write the result 
to the output file 


Figure 16.6. Simulation of a series system. 
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REM simulation three Weibully distributed variables in series 
DEFINT I-L 

DIM x(99) 

OPEN “‘c:\data’’ FOR OUTPUT AS #1 LEN = 256 

FOR i = 1 TO 5000 
REM x(1) is Weibull shape parameter=2 and scale parameter=300 
x(1) = 300* (-LOG(RND)) * (1 / 2) 
REM x(2) is Weibull shape parameter=4 and scale parameter=100 
x(2) =100* (-LOG(RND)) * (1 / 4) 

REM x(3) is Weibull shape parameter=0.5 and scale parameter=200 
x(3) = 200* (-LOG(RND)) * (1 / .5) 

min = 999999999 

FOR j = 1 T03 

IF x(j) < min THEN min = x(j) 

NEXT 5 

y=min 

PRINT #1, USING “#########4# . ##4HE': y 

PRINT i 

NEXT i 

CLOSE 


For a series system, the time to fail is the minimum of the times to fail of the 
components in series. A parallel system could be modeled by altering the 
above code to take the maximum time to fail of each of the components. 
Figure 16.7 is a histogram of the resulting data for the series system. 


600;— 


400-- 


Frequency 


Time to fail 


Figure 16.7. Histogram of a series system. 
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The large number of early failures are caused by the component with the 
high infant mortality rate (6 = 0.5). The result is a distribution that does 
not appear to conform to any known distributions. However, with 5,000 
points, a reliability function can be built empirically. The result is shown in 
Figure 16.8. 


R(t) 


Figure 16.8. Reliability function for a series system. 


The following steps are used to simulate the above problem using an elec- 
tronic spreadsheet: 

1. Incell AZ place the formula 

300*(—@I1n(@rand))(1 /2) 

2. IncellA2 place the formula 

100*(—@In(@rand))\(1 /4) 

3. IncellA3 place the formula 

200*(—@I1n(@rand))*(1/0.5) 

4. IncellA4 place the formula 

@min(A1.. A4) 

5. Copy the contents of row A 5,000 times. 

Now consider a system with two Weibully distributed components, A and B. 
Component B is standby redundant, and the switching mechanism has a relia- 
bility of 95%. The parameters of component A are 8 = 3, 0 = 85. The para- 
meters of component B are 6 = 4.4, 0 = 97. The code below models this 
system; a flow chart is given in Figure 16.9. 


588 Risk ASSESSMENT 


Open data file 
for output 


Generate two Weibull 
random numbers 


No, time is sum 
of both random 
numbers 


Yes, time is 
the random 
number 


Write the result 
to the output file 


Figure 16.9. Simulation of a switching system. 


REM simulation of a switch for two Weibully distributed variables 
DEFINT I-L 

OPEN ‘‘c:\data’’ FOR OUTPUT AS #1 LEN = 256 

FOR i =1 TO 5000 

REM x is Weibull shape parameter=3 and scale parameter=85 

x = 85 * (-LOG(RND) )* (1/3) 

REM y is Weibull shape parameter=4.4 and scale parameter=97 
y = 97 * (-LOG(RND) )*(1/4.4) 

S=RND 

IF s>=.05 THEN swr=1 ELSE swr=0 

IF swr=1 THEN z=x+y ELSE z=x 
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PRINT #1, USING “#######HHHE HEHEHE Vv 
PRINT i 

NEXT i 

CLOSE 


A histogram of the 5,000 data points written to the data file is shown in Figure 
16.10. 

The histogram shows the time to fail for the system following a Weibull dis- 
tribution. The reliability function for this system, built from the 5,000 simu- 
lation points, is shown in Figure 16.11. 

This situation can be simulated using an electronic spreadsheet. The required 
steps follow: 

1. Incell AZ place the formula 

85*(@In(@rand)) (1/3) 
2. IncellA2 place the formula 
97*(@In(@rand))*(1 /4.5) 
3. IncellA3 place the formula 
@if(@rand<0.05,+.A1,+A1+A2) 
4. Copy the contents of row A 5,000 times. 


In step 3 above, the reliability of the switch is tested using the unit, uniform 
random number generator. If the unit, uniform random number is less than 
0.05, the switch fails, and the time to fail for the system is the time to fail for com- 
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Figure 16.10. Histogram of a switching system. 
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R(x) 


0.44 


Figure 16.11. Reliability function for a switching system. 


ponent A (the value in cell A1). If the switch operates, the system time to fail is 
the sum of the values in cells Al and A2. 

In summary, simulation is a powerful analytical tool that can be used to 
model virtually any system. For the above examples, 5,000 iterations were 
used. The number of iterations used should be based on reaching a steady-state 
condition. Depending on the problem more or less iterations may be needed. 

Once simulation is mastered, a danger is that it is overused because of the 
difficulty involved with mathematical models. Do not be tempted to use 
simulation before exploring other options. When manipulating models, mathe- 
matical models lend themselves to optimization whereas simulation models 
require trial and error for optimization. 


Risk assessment tools 


While reliability prediction is a valuable activity, it is even more important to 
design reliable systems in the first place. Proposed designs must be evaluated 
to detect potential failures prior to building the system. Some failures are more 
important than others, and the assessment should highlight those failures most 
deserving of attention and scarce resources. Once failures have been identified 
and prioritized, a system can be designed that is robust, i.e., it is insensitive to 
most conditions that might lead to problems. 
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DESIGN REVIEW 


Design reviews are conducted by specialists, usually working on teams. 
Designs are, of course, reviewed on an ongoing basis as part of the routine work 
of a great number of people. However, the term as used here refers to the formal 
design review process. The purposes of formal design review are threefold: 

1. Determine if the product will actually work as desired and meet the 

customer’s requirements. 

2. Determine if the new design is producible and inspectable. 

3. Determine if the new design is maintainable and repairable. 

Design review should be conducted at various points in the design and pro- 
duction process. Review should take place on preliminary design sketches, 
after prototypes have been designed, and after prototypes have been built and 
tested, as developmental designs are released, etc. Designs subject to review 
should include parts, sub-assemblies, and assemblies. 


FAULT-TREE ANALYSIS (FTA) 


While FMEA (see below) is a bottom-up approach to reliability analysis, 
FTA is a top-down approach. FTA provides a graphical representation of the 
events that might lead to failure. Some of the symbols used in construction of 
fault trees are shown in Table 16.3. 

In general, FTA follows these steps: 

1. Define the top event, sometimes called the primary event. This is the 

failure condition under study. 

2. Establish the boundaries of the FTA. 

3. Examine the system to understand how the various elements relate to 

one another and to the top event. 

4. Construct the fault tree, starting at the top event and working downward. 

5. Analyze the fault tree to identify ways of eliminating events that lead to 

failure. 

6. Prepare a corrective action plan for preventing failures and a contin- 

gency plan for dealing with failures when they occur. 

7. Implement the plans. 

8. Return to step #1 for the new design. 

Figure 16.12 illustrates an FTA for an electric motor. 


Safety analysis 
Safety and reliability are closely related. A safety problem is created when a 
critical failure occurs, which reliability theory addresses explicitly with such 
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Table 16.3. Fault-tree symbols. 
Source: Handbook of Reliability Engineering and Management, McGraw-Hill, reprinted 


with permission of the publisher. 


of the input events occur 


m-out-of-n gate 
(voting or sample 


Output event occurs if m-out-of-7 input 


GATE SYMBOL GATE NAME CAUSAL RELATIONS 

a AND gate Output event occurs if all the input events 
occur simultaneously 

as OR gate Output event occurs if any one of the 
input events occurs 

O- Inhibit gate Input produces output when conditional 
event occurs 

a Priority AND gate Output event occurs if all input events 
occur in the order from left to right 

i Exclusive OR gate Output event occurs if one, but not both, 

aN 


events occur 


gate) 
EVENT SYMBOL MEANING 
a Event represented by a gate 
rectangle 
Basic event with sufficient data 
circle 
: Undeveloped event 

diamond 


switch or 
house 


Either occurring or not occurring 


SD ova 


Transfer symbol 


Conditional event used with inhibit gate 


jS\ Ten 
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Motor does 
not operate 


No current to 
motor 


Fuse fails 
open 


Secondary 
fuse failure 
Fuse fails 
open 
Overload in 
circuit 


supply 
failure 


Figure 16.12. Fault tree for an electric motor. 
Source: Handbook of Reliability Engineering and Management, McGraw-Hill, 
reprinted with permission of the publisher. 


tools as FMEA and FTA. The modern evaluation of safety/reliability takes into 
account the probabilistic nature of failures. With the traditional approach a 
safety factor would be defined using Equation 16.9. 


average strength 
(ane eee (16.9) 
worst expected stress 


The problem with this approach is quite simple: it doesn’t account for vari- 
ation in either stress or strength. The fact of the matter is that both strength 
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AVERAGE 
DIFFERENCE 


STRESS 
STRENGTH 


STRESS EXCEEDS STRENGTH 


Figure 16.13. Modern view of safety factors. 


and stress will vary over time, and unless this variation is dealt with explicitly we 
have no idea what the “safety factor” really is. The modern view is that a safety 
factor is the difference between an improbably high stress (the maximum 
expected stress, or “reliability boundary”) and an improbably low strength 
(the minimum expected strength). Figure 16.13 illustrates the modern view of 
safety factors. The figure shows two distributions, one for stress and one for 
strength. 

Since any strength or stress is theoretically possible, the traditional concept 
of a safety factor becomes vague at best and misleading at worst. To deal intel- 
ligently with this situation, we must consider probabilities instead of possibili- 
ties. This is done by computing the probability that a stress/strength 
combination will occur such that the stress applied exceeds the strength. It is 
possible to do this since, if we have distributions of stress and strength, then 
the difference between the two distributions is also a distribution. In particular, 
if the distributions of stress and strength are normal, the distribution of the dif- 
ference between stress and strength will also be normal. The average and stan- 
dard distribution of the difference can be determined using statistical theory, 
and are shown in Equations 16.10 and 16.11. 


2 2 2 
Osp = OSTRENGTH + OSTRESS (16.10) 


Msp = LstRENGTH — L-STRESS (16.11) 


In Equations 16.10 and 16.11 the SF subscript refers to the safety factor. 
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EXAMPLE OF COMPUTING PROBABILITY OF 
FAILURE 


Assume that we have normally distributed strength and stress. Then the dis- 
tribution of strength minus stress is also normally distributed with the mean 
and variance computed from Equations 16.10 and 16.11. Furthermore, the prob- 
ability of a failure is the same as the probability that the difference of strength 
minus stress is less than zero. That is, a negative difference implies that stress 
exceeds strength, thus leading to a critical failure. 

Assume that the strength of a steel rod is normally distributed with 
i 50,0007 ando = 5,000", The steel rod is to be used as an undertruss on a 
conveyor system. The stress observed in the actual application was measured 
a strain gages and it we found to have a normal distribution with 

= 30,000" and o = 3,000". What is the expected reliability of this system? 


Solution 
The mean variance and standard deviation of the difference is first computed 
using Equations 16.10 and 16.11, giving 


2 2 2 2 2 
ODIFFERENCE = OSTRENGTH + OstTRESs = 5:000° + 3,000° = 34,000,000 
= ./34,000,000 = 5,831" 


LMLDIFFERENCE = ESTRENGTH — ESTRESS = 50,000" = 30,000" = 20,000" 


We now compute Z which transforms this normal distribution to a standard 
normal distribution (see Chapter 9). 


_ OF — 20,0007 


58317 3.43 

Using a normal table (Appendix Table 2), we now look up the probability 
associated with this Z value and find it is 0.0003. This is the probability of failure, 
about 3 chances in 10,000. The reliability is found by subtracting this probability 
from 1, giving 0.9997. Thus, the reliability of this system (and safety for this par- 
ticular failure mode) is 99.97%. This example is summarized in Figure 16.14. 
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STRESS EXCEEDS STRENGTH | STRENGTH EXCEEDS STRESS 


STRESS EXCEEDS 
STRENGTH IN 0.03% 
OF ALL CASES 


O# 20,000# 


STRENGTH — STRESS 


Figure 16.14. Distribution of strength minus stress. 


FAILURE MODE AND EFFECT ANALYSIS (FMEA) 


Failure mode and effect analysis, or FMEA, is an attempt to delineate all 
possible failures, their effect on the system, the likelihood of occurrence, and 
the probability that the failure will go undetected. FMEA provides an excel- 
lent basis for classification of characteristics, i.e., for identifying CTQs and 
other critical variables. As with Pareto analysis, one objective of FMEA is to 
direct the available resources toward the most promising opportunities. An 
extremely unlikely failure, even a failure with serious consequences, may not 
be the best place to concentrate preventative efforts. FMEA can be combined 
with decision analysis methods such as AHP and QFD to help guide preven- 
tive action planning. 

FMEA came into existence on the space program in the 1960s. Later it was 
incorporated into military standards, in particular Mil-Std-1629A.” There are 
two primary approaches for accomplishing an FMEA: 


The hardware approach which lists individual hardware items and ana- 
lyzes their possible failure modes. This FMEA approach is sometimes 
used in product DFSS projects. 

The functional approach which recognizes that every item is designed to 
perform a number of functions that can be classified as outputs. The out- 


*Mil-Std-1629A actually calls the approach FMECA, which stands for Failure mode, effect, and criticality analysis, but over 


time the “C” has been dropped from common usage. However, criticality analysis is still very much a part of FMEA. 
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puts are listed and their failure modes analyzed. This approach to FMEA 
is most common on both DMAIC and DMADV projects involving 


improvement of processes or complex systems. 


FMEA process 

The FMEA is an integral part of the early design process and it should take 
place during the improve phase of DMAIC or the design phase of DMADV. 
FMEAs are living documents and they must be updated to reflect design 
changes, which makes them useful in the control or verify phases as well. The 
analysis is used to assess high risk items and the activities underway to provide 
corrective actions. The FMEA is also used to define special test considerations, 
quality inspection points, preventive maintenance actions, operational con- 
straints, useful life, and other pertinent information and activities necessary to 
minimize failure risk. All recommended actions which result from the FMEA 
must be evaluated and formally dispositioned by appropriate implementation 
or documented rationale for no action. The following steps are used in perform- 
ing an FMEA: 


a. Define the system to be analyzed. Complete system definition includes 
identification of internal and interface functions, expected performance 
at all system levels, system restraints, and failure definitions. 
Functional narratives of the system should include descriptions of each 
goal in terms of functions which identify tasks to be performed for each 
goal and operational mode. Narratives should describe the environmen- 
tal profiles, expected cycle times and equipment utilization, and the 
functions and outputs of each item. 

b. Construct process maps which illustrate the operation, interrelation- 
ships, and interdependencies of functional entities. 

c. Conduct SIPOC analysis for each subprocess in the system. All process 
and system interfaces should be indicated. 

d. List the intended function of each step in the process or subprocess. 

e. For each process step, identify all potential item and interface failure 
modes and define the effect on the immediate function or item, on the 
system, and on the mission to be performed for the customer. 

f. Evaluate each failure mode in terms of the worst potential consequences 
which may result and assign a severity classification category, or SEV 
(see Table 16.4). 

g. Determine the likelihood of occurrence of each failure mode and assign 
an occurrence risk category, or OCC (see Table 16.4). 
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Table 16.4. FMEA severity, likelihood, detectability rating guidelines. 


failure’s effect to the 


this failure to occur? 


Severity Occurrence Detectability 
Rating (SEV) (OCC) (DET) 
How significant is this | How likely is the cause of How likely is it that 


the existing system 


Continued on next page... 


e customer? will detect the cause, if 

a it occurs? 

S 

FA Note: p is the 
estimated probability 
of failure not being 
detected. 

1 Minor. Customer Not likely. Nearly certain to 
won't notice the effect detect before reaching 
or will consider it the customer. 
insignificant. By 

(p 0) 

2 Customer will notice | Documented low failure Extremely low 

the effect. rate. probability of reaching 
the customer without 
detection. 
(0 <p < 0.01) 

3 Customer will become | Undocumented low failure | Low probability of 
irritated at reduced rate. reaching the customer 
performance. without detection. 

(0.01 < p <0.05) 

4 Marginal. Customer Failures occur from time-to- | Likely to be detected 
dissatisfaction dueto | time. before reaching the 
reduced performance. customer. 

(0.05 < p < 0.20) 

5 Customer’s Documented moderate Might be detected 
productivity is failure rate. before reaching the 
reduced. customer. 


(0.20 < p < 0.50) 
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Table 16.4 (continued) 

6 Customer will Undocumented moderate Unlikely to be 
complain. Repair or failure rate. detected before 
return likely. Increased reaching the customer. 
i it 
internal costs (scrap, (0.50 <p < 070) 
rework, etc.). 

7 Critical. Reduced Documented high failure Highly unlikely to 
customer loyalty. rate. detect before reaching 
Internal operations the customer. 

lyi : 
adversely impacted (0.70 <p < 0.90) 

8 Complete loss of Undocumented high failure | Poor chance of 

customer goodwill. rate. detection. 
I i 

nternal operations (0.90 <p <0.95) 
disrupted. 

9 Customer or employee | Failures common. Extremely poor 
safety compromised. chance of detection. 
Regul li 

egulatory compliance (0.95 <p <0.99) 
questionable. 
10 Catastrophic. Failures nearly always occur. | Nearly certain that 
Customer or employee failure won’t be 
endangered without detected. 


warning. Violation of 
law or regulation. 


(p © 1) 


— 


. 


Identify failure detection methods and assign a detectability risk cate- 
gory, or DET (see Table 16.4). 

Calculate the risk priority number (RPN) for the current system. RPN 
= SEV x OCC x DET. 

Determine compensating provisions for each failure mode. 

Identify corrective design or other actions required to eliminate failure 
or control the risk. Assign responsibility and due dates for corrective 
actions. 

Identity effects of corrective actions on other system attributes. 
Identify severity, occurrence, and detectability risks after the corrective 
action and calculate the “after” RPN. 

Document the analysis and summarize the problems which could not be 
corrected and identify the special controls which are necessary to reduce 
failure risk. 
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RPNs are useful in setting priorities, with larger RPNs receiving greater 
attention than smaller RPNs. Some organizations have guidelines requiring 
action based on the absolute value of the RPN. For example, Boeing recom- 
mends that action be required if the RPN > 120. 

A worksheet similar to worksheet 1 can be used to document and guide the 
team in conducting an FMEA. FMEA is incorporated into software packages, 
including some that perform QFD. There are numerous resources available on 
the web to assist you with FMEA, including spreadsheets, real-world examples 
of FMEA, and much more.* 


STATISTICAL TOLERANCING 


For our discussion of statistical tolerancing we will use the definitions of 
limits proposed by Juran and Gryna (1993), which are shown in Table 16.5. 

In manufacturing it is common that parts interact with one another. A pin 
fits through a hole, an assembly consists of several parts bonded together, etc. 
Figure 16.15 illustrates one example of interacting parts. 

Suppose that all three layers of this assembly were manufactured to the speci- 
fications indicated in Figure 16.15. A logical specification on the overall stack 
height would be found by adding the nominal dimensions and tolerances for 
each layer; e.g., 0.175" + 0.0035", giving limits of 0.1715" and 0.1785". The lower 
specification is equivalent to a stack where all three layers are at their mini- 
mums, the upper specification is equivalent to a stack where all three layers are 
at their maximums, as shown in Table 16.6. 

Adding part tolerances is the usual way of arriving at assembly tolerances, 
but it is usually too conservative, especially when manufacturing processes are 
both capable and in a state of statistical control. For example, assume that the 
probability of getting any particular layer below its low specification was 1 in 
100 (which is a conservative estimate for a controlled, capable process). Then 
the probability that a particular stack would be below the lower limit of 
0.1715" is 


1 1 1 1 
— X — X — = —— 
100 100 100 1,000,000 


Similarly, the probability of getting a stack that is too thick would be 1 in a mil- 
lion. Thus, setting component and assembly tolerances by simple addition is 
extremely conservative, and often costly. 


*http://www.fmeainfocentre.com/ 
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Table 16.5. Definitions of limits. 


NAME OF LIMIT MEANING 

Tolerance Set by the engineering design function to define the 
minimum and maximum values allowable for the product 
to work properly 

Statistical tolerance Calculated from process data to define the amount of 


variation that the process exhibits; these limits will 
contain a specified proportion of the total population 


Prediction Calculated from process data to define the limits which 
will contain all of k future observations 

Confidence Calculated from data to define an interval within which a 
population parameter lies 

Control Calculated from process data to define the limits of chance 


(random) variation around some central value 


The statistical approach to tolerancing is based on the relationship between 
the variances of a number of independent causes and the variance of the depen- 
dent or overall result. The equation is: 


a 2 2 2 
Oresult = Oe A a O cause B oP O cause Cc ee (16.12) 


LAYER 1: 0.025" +/- 0.001" 


LAYER 2: 0.100" +/- 0.0005" 


STACK 
HEIGHT 


LAYER 3: 0.050" +/- 0.002" 


Figure 16.15. A multilevel circuit board assembly. 
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Table 16.6. Minimum and maximum multilayer assemblies. 


MINIMUM MAXIMUM 
0.0240 0.0260 
0.0995 0.1005 
0.0480 0.0520 
0.1715 0.1785 


For our example, the equation is 


= 2 2 2 
Ostack = layer 1 a layer 2 t layer 3 (16.13) 


Of course, engineering tolerances are usually set without knowing which 
manufacturing process will be used to manufacture the part, so the actual vari- 
ances are not known. However, a worst-case scenario would be where the pro- 
cess was just barely able to meet the engineering requirement. In Chapter 13 
(process capability) we learned that this situation occurs when the engineering 
tolerance is 6 standard deviations wide (-E3 standard deviations). Thus, we can 


write Equation 16.14 as 
Tu\ ik Tey 
(=) +(¥) (16.14) 
3 3 


=/G)* 


Tee = ie 1 + ae 2 ae Ty, 


layer 3 


or 


In other words, instead of simple addition of tolerances, the squares of the 
tolerances are added to determine the square of the tolerance for the overall 
result. 

The result of the statistical approach is a dramatic increase in the allowable 
tolerances for the individual piece-parts. For our example, allowing each layer 
a tolerance of -£0.002" would result in the same stack tolerance of 0.0035". This 
amounts to doubling the tolerance for layer 1 and quadrupling the tolerance 
for layer 3, without changing the tolerance for the overall stack assembly. 
There are many other combinations of layer tolerances that would yield the 
same stack assembly result, which allows a great deal of flexibility for con- 
sidering such factors as process capability and costs. 
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The penalty associated with this approach is a slight probability of an out-of- 
tolerance assembly. However, this probability can be set to as small a number 
as needed by adjusting the 3 sigma rule to a larger number. Another alternative 
is to measure the sub-assemblies prior to assembly and selecting different com- 
ponents in those rare instances where an out-of-tolerance combination results. 

It is also possible to use this approach for internal dimensions of assemblies. 
For example, assume we had an assembly where a shaft was being assembled 
with a bearing as shown in Figure 16.16. 


Bearing 


Shaft 


“a 


0.997 +/- 0.001 1.000 +/- 0.001 


Me 


Figure 16.16. A bearing and shaft assembly. 


The clearance between the bearing and the shaft can be computed as 
Clearance = Bearing inside diameter — Shaft outside diameter 


The minimum clearance will exist when the bearing inside diameter is at its 
smallest allowed and the shaft outside diameter is at its largest allowed. Thus, 


Minimum clearance = 0.999" — 0.998" = 0.001" 


The maximum clearance will exist when the bearing inside diameter is at its 
largest allowed and the shaft outside diameter is at its smallest allowed, 


Maximum clearance = 1.001" — 0.996" = 0.005" 
Thus, the assembly tolerance can be computed as 
T assembly = 0-005" — 0.001" = 0.004" 


The statistical tolerancing approach is used here in the same way as it was 
used above. Namely, 
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dame Cy ware cot 
== / (=) +(2) (16.15) 


or 


= 2 2. 
Tes ceieBhy = F Pei + T haf 


For our example we get 


T sembly = 0.004"= hoe oe Fe (16.16) 


If we assume equal tolerances for the bearing and the shaft the tolerance for 
each becomes 


(0.004)” = Thearing + Tehaft = 2T” 


0.004)? (16.17) 
, (0.004)" 5 ) = +0.0028 


Which nearly triples the tolerance for each part. 


Assumptions of formula 


The formula is based on several assumptions: 

e The component dimensions are independent and the components are 
assembled randomly. This assumption is usually met in practice. 

e Each component dimension should be approximately normally distribu- 
ted. 

e The actual average for each component is equal to the nominal value 
stated in the specification. For the multilayer circuit board assembly 
example, the averages for layers 1, 2, and 3 must be 0.025", 0.100", and 
0.050" respectively. This condition can be met by applying SPC to the man- 
ufacturing processes. 

Reasonable departures from these assumptions are acceptable. The author’s 

experience suggests that few problems will appear as long as the sub-assembly 
manufacturing processes are kept in a state of statistical control. 
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Tolerance intervals 


We have found that confidence limits may be determined so that the interval 
between these limits will cover a population parameter with a specified con- 
fidence, that is, a specified proportion of the time. Sometimes it is desirable to 
obtain an interval which will cover a fixed portion of the population distrib- 
ution with a specified confidence. These intervals are called tolerance intervals, 
and the end points of such intervals are called tolerance limits. For example, a 
manufacturer may wish to estimate what proportion of product will have 
dimensions that meet the engineering requirement. In Six Sigma, tolerance 
intervals are typically of the form X + Ks, where K is determined, so that the 
interval will cover a proportion P of the population with confidence y. 
Confidence limits for ju are also of the form X + Ks. However, we determine 
K so that the confidence interval would cover the population mean ju a certain 
proportion of the time. It is obvious that the interval must be longer to cover a 
large portion of the distribution than to cover just the single value ju. Table 8 
in the Appendix gives K for P = 0.90, 0.95, 0.99, 0.999 and y = 0.90, 0.95, 0.99 
and for many different sample sizes n. 


EXAMPLE OF CALCULATING A TOLERANCE 
INTERVAL 


Assume that a sample ofn = 20froma stable process produced the following 
results: X = 20, s =1.5. We can estimate that the interval X +Ks = 
20 + 3.615(1.5) = 20 + 5.4225, or the interval from 14.5775 to 25.4225 will con- 
tain 99% of the population with confidence 95%. The K values in the table 
assume normally distributed populations. 
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CHAPTER 


17 


Design of Experiments 


(DOE) 


Designed experiments play an important role in quality improvement. This 
Chapter will introduce the basic concepts involved and it will contrast the sta- 
tistically designed experiment with the “one factor at atime” (OFAT) approach 
that has been used traditionally. Also briefly discussed are the concepts involved 
in Taguchi methods, statistical methods named after their creator, Dr. Genichi 


Taguchi. 


The traditional approach vs. statistically designed experiments 
The traditional approach, which most of us learned in high school science 
class, is to hold all factors constant except one. When this approach is used we 
can be sure that the variation is due to a cause and effect relationship or so we 
are told. However, this approach suffers from a number of problems: 
¢ It usually isn’t possible to hold all other variables constant. 
e There is no way to account for the effect of joint variation of independent 
variables, such as interaction. 
e There is no way to account for experimental error, including measure- 
ment variation. 
The statistically designed experiment usually involves varying two or more 
variables simultaneously and obtaining multiple measurements under the 
same experimental conditions. The advantage of the statistical approach is 


three-fold: 


Copyright 2003 by The McGraw-Hill Companies, Inc. Click Here for Terms of Use. 
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1. Interactions can be detected and measured. Failure to detect interactions 
is a major flaw in the OFAT approach. 

2. Each value does the work of several values. A properly designed exper- 
iment allows you to use the same observation to estimate several differ- 
ent effects. This translates directly to cost savings when using the 
statistical approach. 

3. Experimental error is quantified and used to determine the confidence 
the experimenter has in his conclusions. 


TERMINOLOGY 


Much of the early work on the design of experiments involved agricultural 
studies. The language of experimental design still reflects these origins. The 
experimental area was literally a piece of ground. A block was a smaller piece 
of ground with fairly uniform properties. A plot was smaller still and it served 
as the basic unit of the design. As the plot was planted, fertilized and harvested, 
it could be split simply by drawing a line. A treatment was actually a treatment, 
such as the application of fertilizer. Unfortunately for the Six Sigma analyst, 
these terms are still part of the language of experiments. The analyst must do 
his or her best to understand quality improvement experimenting using these 
terms. Natrella (1963) recommends the following: 


Experimental area can be thought of as the scope of the planned exper- 
iment. For us, a block can be a group of results from a particular operator, 
or from a particular machine, or ona particular day—any planned natural 
grouping which should serve to make results from one block more alike 
than results from different blocks. For us, a treatment is the factor being 
investigated (material, environmental condition, etc.) in a single factor 
experiment. In factorial experiments (where several variables are being 
investigated at the same time) we speak of a treatment combination and 
we mean the prescribed levels of the factors to be applied to an experimen- 
tal unit. For us, a yield is a measured result and, happily enough, in chem- 
istry it will sometimes be a yield. 


Definitions 


A designed experiment is an experiment where one or more factors, called 
independent variables, believed to have an effect on the experimental outcome 
are identified and manipulated according to a predetermined plan. Data col- 
lected from a designed experiment can be analyzed statistically to determine 
the effect of the independent variables, or combinations of more than one inde- 
pendent variable. An experimental plan must also include provisions for dealing 
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with extraneous variables, that is, variables not explicitly identified as indepen- 
dent variables. 

Response variable—The variable being investigated, also called the depen- 
dent variable, sometimes called simply response. 

Primary variables—The controllable variables believed most likely to have 
an effect. These may be quantitative, such as temperature, pressure, or 
speed, or they may be qualitative such as vendor, production method, 
operator. 

Background variables—Variables, identified by the designers of the exper- 
iment, which may have an effect but either cannot or should not be 
deliberately manipulated or held constant. The effect of background 
variables can contaminate primary variable effects unless they are prop- 
erly handled. The most common method of handling background vari- 
ables is blocking (blocking is described later in this chapter). 

Experimental error—In any given experimental situation, a great many 
variables may be potential sources of variation. So many, in fact, that 
no experiment could be designed that deals with every possible source 
of variation explicitly. Those variables that are not considered explic- 
itly are analogous to common causes of variation. They represent the 
“noise level” of the process and their effects are kept from contaminat- 
ing the primary variable effects by randomization. Randomization is a 
term meant to describe a procedure that assigns test units to test condi- 
tions in such a way that any given unit has an equal probability of 
being processed under a given set of test conditions. 

Interaction—A condition where the effect of one factor depends on the 
level of another factor. Interaction is illustrated in Figure 17.1. 


INTERACTION PRESENT NO INTERACTION PRESENT 


B-HIGH 
B-HIGH B-LOW 


Za“ 
Za 


A-LOW A-HIGH A-LOW A-HIGH 


Figure 17.1. Illustration of interaction. 
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POWER AND SAMPLE SIZE 


In designed experiments, the term power of the test refers to the probability 
that the F test will lead to accepting the alternative hypothesis when in fact the 
alternative hypothesis holds, i.e., 1-6. To determine power probabilities we 
use the non-central F distribution. Charts have been prepared to simplify this 
task (see Appendix Table 14). The tables are indexed by values of @. When all 
sample sizes are of equal size n, ¢ is computed using Equation 17.1. 


= + Eu — py 
where (17.1) 


bi; 
pests 


r 


r is the number of factor levels being studied. 

The tables in Appendix 14 are used as follows: 

1. Each page refers toa different v, = r — 1, the number of degrees of free- 
dom for the numerator of the F statistic. 

2. Two levels of significance are shown, @ = 0.01 anda = 0.05. The left set 
of curves are used for @ = 0.05 and the right set when aw = 0.01. 

3. There are separate curves for selected values of v) = D> n — r, the num- 
ber of degrees of freedom for the denominator of the F statistic. 

4. TheX scale is in units of . 

5. The Y scale gives the power, 1 — B. 


Example 


Consider the curve on the third table of Appendix Table 14 for a = 0.05, 
V, = 3, vy = 12. This ANOVA tests the hypothesis that four populations 
(v, = 4—1 = 3) have equal means with sample sizes of n = 4 from each popu- 
lation (v) = 16 — 4 = 12). Reading above @ = 2, we see that the chance of 
recognizing that the four populations do not actually have equal means when 
o = 2 is 0.82. It must be understood that there are many combinations of four 
unequal means that would produce @ = 2. 


DESIGN CHARACTERISTICS 


Good experiments don’t just happen, they are a result of careful planning. A 
good experimental plan depends on (Natrella 1963): 
e The purpose of the experiment 
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e Physical restrictions on the process of taking measurements 

e Restrictions imposed by limitations of time, money, material, and person- 

nel. 

The analyst must explain clearly why the experiment is being done, why the 
experimental treatments were selected, and how the completed experiment 
will accomplish the stated objectives. The experimental plan should be in writ- 
ing and it should be endorsed by all key participants. The plan will include a 
statement of the objectives of the experiment, the experimental treatments to 
be applied, the size of the experiment, the time frame, and a brief discussion of 
the methods to be used to analyze the results. Two concepts are of particular 
interest to the Six Sigma analyst, replication and randomization. 

Replication—The collection of more than one observation for the same set 
of experimental conditions. Replication allows the experimenter to 
estimate experimental error. If variation exists when all experimental 
conditions are held constant, the cause must be something other than 
the variables being controlled by the experimenter. Experimental 
error can be estimated without replicating the entire experiment. If a 
process has been in statistical control for a period of time, experimental 
error can be estimated from the control chart. Replication also serves 
to decrease bias due to uncontrolled factors. 

Randomization—In order to eliminate bias from the experiment, variables 
not specifically controlled as factors should be randomized. This 
means that allocations of specimens to treatments should be made 
using some mechanical method of randomization, such as a random 
numbers table. Randomization also assures valid estimates of experi- 
mental error. 


TYPES OF DESIGN 


Experiments can be designed to meet a wide variety of experimental objec- 
tives. A few of the more common types of experimental designs are defined here. 
Fixed-effects model—An experimental model where all possible factor 
levels are studied. For example, if there are three different materials, 
all three are included in the experiment. 
Random-effects model—An experimental model where the levels of factors 
evaluated by the experiment represent a sample of all possible levels. 
For example, if we have three different materials but only use two 
materials in the experiment. 
Mixed model—An experimental model with both fixed and random effects. 
Completely randomized design—An experimental plan where the order in 
which the experiment is performed is completely random, e.g., 
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LEVEL TEST SEQUENCE NUMBER 
A 7,1,5 
B 2, 3,6 
C 8,4 


Randomized-block design—An experimental design is one where the 
experimental observations are divided into “blocks” according to 
some criterion. The blocks are filled sequentially, but the order within 
the block is filled randomly. For example, assume we are conducting a 
painting test with different materials, material A and material B. We 
have four test pieces of each material. Ideally we would like to clean all 
of the pieces at the same time to assure that the cleaning process doesn’t 
have an effect on our results; but what if our test requires that we use a 
cleaning tank that cleans two test pieces at a time? The tank load then 
becomes a “blocking factor.” We will have four blocks, which might 


look like this: 
MATERIAL TANK LOAD TEST PIECE NUMBER 
A 1 7 
B 1 
B 2. 5 
A 2 
B 3 3 
A 6 
B 4 4 
A 8 


Since each material appears exactly once per cleaning tank load we say 
the design is balanced. The material totals or averages can be compared 
directly. The reader should be aware that statistical designs exist to 
handle more complicated “unbalanced designs.” 
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Latin-square designs—Designs where each treatment appears once and 
only once in each row and column. A Latin-square plan is useful 
when it is necessary or desirable to allow for two specific sources 
of non-homogeneity in the conditions affecting test results. Such 
designs were originally applied in agricultural experimentation 
when the two sources of non-homogeneity were the two directions 
on the field and the “square” was literally a square piece of ground. 
Its usage has been extended to many other applications where 
there are two sources of non-homogeneity that may affect experi- 
mental results—for example, machines, positions, operators, runs, 
days. A third variable is then associated with the other two in a 
prescribed fashion. The use of Latin squares is restricted by two 


conditions: 
1. the number of rows, columns and treatments must all be the 
same; 


2. there must be no interactions between row and column factors. 

Natrella (1963, pp. 13-30) provides the following example of a Latin 
square. Suppose we wish to compare four materials with regard to 
their wearing qualities. Suppose further that we have a wear-testing 
machine which can handle four samples simultaneously. Two sources 
of inhomogeneity might be the variations from run to run, and the var- 
iation among the four positions on the wear machine. In this situation, 
a4 x 4 Latin square will enable us to allow for both sources of inhomo- 
geneity if we can make four runs. The Latin square plan is as in Figure 
17.2 (the four materials are labeled A, B, C, D). 

The procedure to be followed in using a given Latin square is as fol- 
lows: 

1. Permute the columns at random; 

2. Permute the rows at random; 

3. Assign letters randomly to the treatments. 


Position Number 
Run (1) (2) (3) (4) 
1 A B C D 
2 B C D A 
3 C D A B 
4 D A B Cc 


Figure 17.2. A4 x 4 Latin square. 
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One-factor 


EXAMPLE OF A ONE-WAY ANOVA 


The following example will be used to illustrate the interpretation of a single 
factor analysis of variance. With the widespread availability of computers, few 
people actually perform such complex calculations by hand. The analysis 
below was performed using Microsoft Excel. Commonly used statistical meth- 
ods such as regression and ANOVA are included in most high-end spreadsheets. 

The coded results in Table 17.1 were obtained from a single factor, com- 
pletely randomized experiment, in which the production outputs of three 
machines (A, B, and C) were to be compared. 


Table 17.1. Experimental raw data (coded). 


A B C 
4 2 —3 
8 0 1 
5 1 —2 
7 2 —1 
6 4 0) 


An ANOVA of these results produced the results shown in Table 17.2. 

The first part of Table 17.2 shows descriptive statistics for the data; the ana- 
lyst should always look carefully at these easily understood results to check for 
obvious errors. The results show that the means vary from a low of —1 for 
machine C to a high of 6 for machine A. 


ANOVA PROCEDURE 

ANOVA proceeds as follows: 

1. State the null and alternative hypotheses: the ANOVA table tests the 
hypotheses: H, (all means are equal) versus H, (at least two of the 
means are different). 

2. Choose the level of significance. For this analysis a significance level 
a = 0.05 was selected. 

3. Compute the F statistic, the ratio of the mean square between groups to 
the mean square within groups. 
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Table 17.2. Results of the analysis. 


ANOVA: SINGLE FACTOR 


SUMMARY 

Groups Count Sum Average | Variance 
A 5 30.000 6.000 2.500 
B 5 9.000 1.800 2.200 
C 5 —5.000 —1.000 2.500 


Source of variation P-value 

Between groups 124,133 2 62.067 25.861 0.000 3.885 
Within groups 28.800 12 2.400 

Total 152.933 14 


4. Assuming that the observations are random samples from normally dis- 
tributed populations with equal variances, and that the hypothesis is 
true, the critical value of F is found in Tables 5 or 6 in the Appendix. 
The numerator will have the degrees of freedom shown in the degrees 
of freedom column for the between groups row. The denominator will 
have the degrees of freedom shown in the degrees of freedom column 
for the within groups row. 

5. Ifthe computed F > F,_, then reject the null hypothesis and conclude 
the alternate hypothesis. Otherwise fail to reject the null hypothesis. 

The ANOVA table shows that for these data F computed is 

62.067/2.4 = 25.861 and F critical at ~ = 0.05 with numerator df = 2 and 
denominator df = 12 is 3.885." Since 25.861 > 3.885 we reject the null hypoth- 
esis and conclude that the machines produce different results. Note that all we 
know is that at least the two extreme machines (A and C) are different. The 
ANOVA does not tell us if A and B or B and C are significantly different. 
There are methods which can make this determination, such as contrasts. The 
reader is referred to a text on design of experiments, e.g, Montgomery (1984) 
for additional information. 


*Referring to the critical value is actually unnecessary; the P-value of 0.000 indicates that the probability of getting an F' value 


as large as that computed is less than 1 in 1,000. 
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PERFORMING ANOVA MANUALLY 


On rare occasions (such as taking a Black Belt exam), the analyst may find 
that computers are not available and the analysis must be performed “by 
hand.” The analysis is illustrated below. 


N Sum of Squares 
TreatmentA | 4,8,5,7,6 30 5 190 
TreatmentB | 2,0,1,2,4 9 5 25 
TreatmentC | —3,1,—2,—1,0 —5 5 15 
Totals 34 15 230 


34) 
Total sum of squares = 230 — oy = 152.933 


30) (9) (=5)°_— (34)? 
Treatment sum of squares = ( ° Ar ° +8 ®) = e = 124.133 


Error sum of squares 
= Total sum of squares — Treatment sum of squares 


= 152.933 — 124.133 = 28.8 


These values are placed in the sum of squares (SS) column in the ANOVA 
table (Table 17.2). The remainder of the ANOVA table is obtained through 


simple division. 


EXAMPLES OF APPLYING COMMON DOE METHODS 
USING SOFTWARE 


This section includes examples of the most commonly used design of experi- 
ment methods using software. Whenever possible the examples employ popular 
software, such as Microsoft Excel. For detailed mathematical background on 
these methods, the reader is referred to any of the many fine books on the 
subject (e.g. Box et al., 1978; Hicks, 1993; Montgomery, 1996). DOE PC, a 
full-featured commercial software for design and analysis of experiments 
is available from http://www.qualityamerica.com. A statistical analysis 
shareware package for Windows operating systems can be downloaded from 
http://www.dagonet.com/scalc.htm. MINITAB includes DOE capabilities. 
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Two-way ANOVA with no replicates 
When experiments are conducted which involve two factors, and it is not 
possible to obtain repeat readings for a given set of experimental conditions, a 
two-way analysis of variance may be used. The following example assumes that 
experimental treatments are assigned at random. Note that if the factors 
involved are each tested at only two levels, the full factorial analysis method 
described below could also be used. 


EXAMPLE OF TWO-WAY ANOVA WITH NO 
REPLICATES 


An experiment was conducted to evaluate the effect of different detergents 
and water temperatures on the cleanliness of ceramic substrates. The experi- 
menter selected three different detergents based on their pH levels, and con- 
ducted a series of experiments at four different water temperatures. 
Cleanliness was quantified by measuring the contamination of a distilled 
water beaker after rinsing the parts cleaned using each treatment combination. 
The coded data are shown in Table 17.3. 


Table 17.3. Cleaning experiment raw data. 


DETERGENT A | DETERGENTB | DETERGENT C 
Cold 15 18 10 
Cool 12 14 9 
Warm 10 18 7 
Hot 6 12 5 


Part one of the Excel output (Table 17.4) provides descriptive statistics on the 
different treatment levels. The ANOVA table is shown in part two. Note that 
in the previously presented raw data table the rows represent the different tem- 
peratures and the columns the different detergents. Because there are no repli- 
cates, Excel is not able to provide an estimate of the interaction of detergent 
and water temperature. If you suspect that an interaction may be present, then 
you should try to replicate the experiment to estimate this effect. For this experi- 
ment, any P-value less than 0.05 would indicate a significant effect. The 
ANOVA table indicates that there are significant differences between the dif- 
ferent detergents and the different water temperatures. To identify which dit- 
ferences are significant the experimenter can examine the means of the 
different detergents and water temperatures using t-tests. (Excel’s data analysis 
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Table 17.4. Cleaning experiment two-way ANOVA output from Microsoft Excel. 
(Two-factor without replication.) 


SUMMARY OUTPUT 

Count Sum | Average | Variance 
Cold water 3 43 4.333333 | 16.33333 
Cool water 3 35 | 11.666667 6.333333 
Warm water 3 35 | 11.666667 | 32.33333 
Hot water 3 23 7.6666667 | 14.33333 
Detergent A 4 43 | 10.75 14.25 
Detergent B 4 62 | 15.5 9 
Detergent C 4 31 7.75 4.916667 
ANOVA 


Source of variation 


68 


22.666667 


8.242424 


P-value 


0.015043179 


4.757055 


122.1666667 


61.083333 


22.21212 


0.001684751 


5.143249 


16.5 


2.75 


206.6666667 


tools add-in includes these tests.) Be aware that the Type I error is affected by 
conducting multiple t-tests. If the Type I error on a single t-test is a, then the 
overall Type I error for k such tests is 1 — (1 — a)". For example, if a = 0.01 
and three pairs of means are examined, then the combined Type I error for all 
three t-tests is 1 — (1 — 0.01)? = 1 — (0.99)* = 0.03. Statistical methods exist 
that guarantee an overall level of Type I error for simultaneous comparisons 
(Hicks, 1973, pp. 31-38). 


Two-way ANOVA with replicates 
If you are investigating two factors which might interact with one another, 

and you can obtain more than one result for each combination of experimental 
treatments, then two-way analysis of variance with replicates may be used for 
the analysis. Spreadsheets such as Microsoft Excel include functions that per- 
form this analysis. 
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EXAMPLE OF TWO-WAY ANOVA WITH REPLICATES 


An investigator is interested in improving a process for bonding photoresist 
to copper clad printed circuit boards. Two factors are to be evaluated: the pres- 
sure used to apply the photoresist material and the pre-heat temperature of the 
photoresist. Three different pressures and three different temperatures are to 
be evaluated; the number of levels need not be the same for each factor and 
there is no restriction on the total number of levels. Each experimental com- 
bination of variables is repeated five times. Note that while Excel requires 
equal numbers of replicates for each combination of treatments, most statistical 
analysis packages allow different sample sizes to be used. The experimenter 
recorded the number of photoresist defects per batch of printed wiring boards. 
The coded data are shown in Table 17.5. 

These data were analyzed using Excel’s two-way ANOVA with replicates 
function. The results are shown in Table 17.6. 

As before, part one of the Excel output provides descriptive statistics on the 
different treatment levels. The ANOVA table is shown in part two. Because 
there are now replicates, Excel is able to provide an estimate of the interaction 
of pressure and temperature. For this experiment, the experimenter decided 
that any P-value less than 0.05 would indicate a significant effect. The 


Table 17.5. Photoresist experiment raw data. ANOVA results. 


HIGH PRESSURE MED PRESSURE LOW PRESSURE 
High temp 39 32 18 
30 31 20 
35 28 21 
43 28 25 
25 29 26 
Med temp 38 10 22 
31 15 28 
31 25 29 
30 31 26 
35 36 20 
Low temp 30 21 25 
35 22 24 
36 25 20 
37 24 21 
39 27 21 
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Table 17.6. Photoresist experiment two-way ANOVA output from Microsoft Excel. 
(Two-factor with replication.) 


SUMMARY OUTPUT 

High pressure Med pressure Low pressure Total 
High temp 
Count 5 5 5 15 
Sum 172 148 110 430 
Average 34.4 29.6 22 28.66667 
Variance 50.8 3.3 11.5 46.66667 
Med temp 
Count 5 5 5 15 
Sum 165 117 125 407 
Average 33 23.4 25 27.13333 
Variance 11.5 117.3 15 59.98095 
Low temp 
Count 5 5 5 15 
Sum 177 119 111 407 
Average 35.4 23.8 22.2 27.13333 
Variance 11.3 5.7 47 43.26667 
Total 
Count 15 15 15 
Sum 514 384 346 
Average 34.26666667 25.6 23.06666667 
Variance 22.06666667 44.68571429 10.92380952 
ANOVA 
Source of variation SS af MS fa P-value F crit 
Sample 23.5111111 2 11.7555556 0.45781 | 0.6363 3.259444 
Columns 1034.84444 2 | 517.422222 20.1506 1.34E-06 | 3.259444 
Interaction 139.555556 4 34.8888889 1.35872 | 0.267501 | 2.633534 
Within 924.4 36 25.6777778 
Total 2122.31111 44 
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ANOVA table P-value of less than 0.001 indicates that there are significant dif- 
ferences between the different columns (pressure), but the P-value of 0.6363 
indicates that there is not a significant difference between the rows (tempera- 
ture). The interaction of pressure and temperature is also not significant, as indi- 
cated by the P-value of 0.267501. 

Since the P-value indicates that at least one difference is significant, we know 
that the largest difference of 34.26666667 — 23.06666667 = 11.2 is significant. 
To identify which other differences are significant the experimenter can exam- 
ine the means of the different pressures using t-tests. (Excel’s data analysis 
tools add-in includes these tests.) Be aware that the Type I error is affected by 
conducting multiple t-tests. If the Type I error on a single t-test is a, then the 
overall Type I error for k such tests is 1 — (1 — a)*. For example, if a = 0.01 
and three pairs of means are examined, then the combined Type I error for all 
three t-tests is 1 — (1 — 0.01)° = 1 — (0.99)° = 0.03. 


Full and fractional factorial 


Full factorial experiments are those where at least one observation is 
obtained for every possible combination of experimental variables. For exam- 
ple, if A has 2 levels, B has 3 levels and C has 5 levels, a full factorial experiment 
would have at least 2 x 3 x 5 = 30 observations. 

Fractional factorial or fractional replicate are experiments where there are 
some combinations of experimental variables where observations were not 
obtained. Such experiments may not allow the estimation of every interaction. 
However, when carefully planned, the experimenter can often obtain all of the 
information needed at a significant saving. 


ANALYZING FACTORIAL EXPERIMENTS 


A simple method exists for analyzing the common 2” experiment. The 
method, known as the Yates method, can be easily performed with a pocket cal- 
culator or programmed into a spreadsheet. It can be used with any properly 
designed 2” experiment, regardless of the number of factors being studied. 

To use the Yates algorithm, the data are first arranged in standard order (of 
course, the actual running order is random). The concept of standard order is 
easier to understand if demonstrated. Assume that we have conducted an experi- 
ment with three factors, A, B, and C. Each of the three factors is evaluated at 
two levels, which we will call low and high. A factor held at a low level will be 
identified with a “—” sign, one held at a high level will be identified with a “+” 
sign. The eight possible combinations of the three factors are identified using 
the scheme shown in the table below. 
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ID A B C 
() - - - 
a + — — 
b = + - 
ab + + 2 
Cc — — + 
ac + — + 

+4 
abc + + + 


Note that the table begins with all factors at their low level. Next, the first fac- 
tor is high and all others are low. When a factor is high, it is shown in the ID 
column, otherwise it is not. For example, whenever a appears it indicates that 
factor A is at its high level. To complete the table you simply note that as each 
factor is added to the table it is “multiplied” by each preceding row. Thus, 
when J is added it is multiplied by a, giving the row ab, When c is added it is 
multiplied by, in order, a, b, and ab, giving the remaining rows in the table. (As 
an exercise, the reader should add a fourth factor D to the above table. Hint: 
the result will be a table with eight more rows.) Once the data are in standard 
order, add a column for the data and one additional column for each variable, 
e.g., for our three variables we will add four columns. 


ID A B C DATA 1 2 3 
() - - - 
a + = — 
b - + = 
ab ae = 
Cc — — + 
ac + 7 + 
bc = F a 
abc + + at 


Record the observations in the data column (if the experiment has been repli- 
cated, record the totals). Now record the sum of the data values in the first two 
rows ie., (1) +a in the first cell of the column labeled column 1. Record the 
sum of the next two rows in the second cell (ie., + ab). Continue until the 
top half of column 1 is completed. The lower half of column 1 is completed 
by subtracting one row from the next, e.g., the fifth value in column 1 is found 
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by subtracting —5 — 2 = —3. After completing column 1 the same process is 
completed for column 2, using the values in column 1. Column 3 is created 
using the values in column 2. The result is shown below. 


ID B 
(1) = 
b + 
ab + 
be + 
abc + 
EXAMPLE OF YATES METHOD 


The table below shows sample data from an actual experiment. The exper- 
iment involved a target shooter trying to improve the number of targets hit per 
box of 25 shots. Three variables were involved: a = the gauge of the shotgun 
(12-gauge and 20-gauge), b = the shot size (6 shot and 8 shot), andc = the length 
of the handle on the target thrower (short or long). The shooter ran the experi- 
ment twice. The column labeled “1st” is the number of hits the first time the 
combination was tried. The column labeled “2nd” is the number of hits the sec- 
ond time the combination was tried. The Yates analysis begins with the sums 
shown in the column labeled Sum. 


ID 1st F ratio 
1 22 Avg. 
a 21 : 1 
20 1 
ab 21 11 4 0.5 1 1.00 1.00 
ac 12 1 
be 13 1 
abc 20 1 
Error 8 55.00 6.88 
Total | 141 | 147 15 | 220.00 
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The first row in the Effect column is simply the first row of column 3 (288) 
divided by the count (r x 2”); this is simply the average. Subsequent rows in 
the Effect column are found by dividing the numbers in column 3 by r x 2”7! 
The Effect column provides the impact of the given factor on the response; 
thus, the shooter hit, on average, 2.5 more targets per box when shooting a 12- 
gauge than he did when shooting a 20-gauge. 

The next question is whether or not these differences are statistically sig- 
nificant, i.e., could they be due to chance alone? To answer this question we 
will use the F-ratio of the effect MS for each factor to the error MS. The degrees 
of freedom (df) for each effect is simply 1 (the number of factor levels minus 
1), the total df is N — 1, and the error df is the total df minus the sum of the fac- 
tor dfs. The sum of squares (SS) for each factor is the column 3 value squared 
divided byr x 2”;e.g.,SS, = 20°/16 = 25. The total SS is the sum of the indivi- 
dual values squared minus the first row in column 3 squared divided by r x 2”; 


e.g., 


288° 
(22° + 21° +... + 15°) T= = 220. 


The error SS is the total SS minus the factor SS. The MS and F columns are 
computed using the same approach as shown above for one-way ANOVA. For 
the example the F-ratio for factor c (thrower) is significant at @ < 0.01 and the 
F-ratio for factor a (gauge) is significant at @ < 0.10; no other F-ratios are sig- 
nificant. 


EMPIRICAL MODEL BUILDING AND SEQUENTIAL 
LEARNING 


If you are new to design of experiments and empirical model building, a 
metaphor may prove helpful. Imagine that you suddenly wake up in a strange 
wilderness. You don’t know where you are, but you'd like to climb to the top 
of the nearest hill to see if there are any signs of civilization. What would you do? 

A first step might be to take a good look around you. Is there anything you 
should know before starting out? You would probably pay particular attention 
to things that might be dangerous. If you are in a jungle these might be dan- 
gerous animals, quicksand, and other things to avoid. You'd also look for things 
that could be used for basic survival, such as food, shelter, and clothing. You 
may wish to establish a “base camp” where you can be assured that all the 
basic necessities are available; a safe place to return to if things get a bit too excit- 
ing. In empirical modeling we also need to begin by becoming oriented with 
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the way things are before we proceed to change them. We will call this knowl- 
edge discovery activity Phase 0. 

Now that you have a feel for your current situation and you feel confident 
that you know something about where you are, you may begin planning your 
trip to the highest hill. Before starting out you will probably try to determine 
what you will need to make the trip. You are only interested in things that are 
truly important. However, since you are new to jungle travel, you decide to 
make a few short trips to be sure that you have what you need. For your first 
trip you pack up every conceivable item and set out. In all likelihood you will 
discover that you have more than you need. Those things that are not important 
you will leave at your camp. As part of your short excursions you also learn 
something about the local terrain close to your camp; not much, of course, but 
enough to identify which direction is uphill. This phase is equivalent to a screen- 
ing experiment, which we call Phase I. 

You now feel that you are ready to begin your journey. You take only those 
things you will need and head out into the jungle in the uphill direction. From 
time to time you stop to get your bearings and to be sure that you are still mov- 
ing in the right direction. We call this hill-climbing steepest ascent, or Phase II. 

At some point you notice that you are no longer moving uphill. You realize 
that this doesn’t mean that you are at the highest point in your area of the jungle, 
only that you are no longer moving in the right direction. You decide to stop 
and make camp. The next morning you begin to explore the local area more 
carefully, making a few short excursions from your camp. The jungle is dense 
and you learn that the terrain in the immediate vicinity is irregular, sometimes 
steep, sometimes less steep. This is in contrast to the smooth and consistent 
uphill slope you were on during your ascent. We call this phase of your journey 
the factorial experiment, or Phase III. 

Now you decide that a more organized approach will be needed to locate the 
nearby peak. You break out the heavy artillery, the GPS you’ve been carrying 
since the beginning! (one of those cheap ones that don’t have built-in maps). 
You take several altitude readings from near your camp, and others at a care- 
fully measured distance on all major compass headings. Each time you carefully 
record the altitude on a hand-drawn map. You use the map to draw contour 
lines of equal altitude and eventually a picture emerges that clearly shows the 
location of the top of the hill. This is the composite design phase, which we call 
Phase IV. 

At last you reach the top of the hill. You climb to the top of a tree and are 
rewarded with a spectacular view, the best for miles around. You decide that 
you love the view so much, you will build your home on this hill and live there 
permanently. You make your home sturdy and strong, able to withstand the 
ravages of wind and weather that are sure to come to your little corner of the 
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jungle. In other words, your home design is robust, or impervious to changes in 
its environment. We call the activity of building products and processes that 
are insensitive to changes in their operating parameters robust product and pro- 
cess design, which is Phase V of the journey. 

Now that this little tale has been told, let’s go on to the real thing, improving 
your products, processes, and services! 


Phase 0: Getting your bearings 


“WHERE ARE WE ANYWAY?” 


Before any experimentation can begin the team should get an idea of what the 
major problems are, important measures of performance, costs, time and other 
resources available for experimentation, etc. Methods and techniques for con- 
ducting Phase 0 research are described in Chapters 8-11. The author recom- 
mends that SPC be applied to the process before experimentation. SPC allows 
the separation of factors into the categories of special and common causes. The 
process of discovering which variables belong to which class is extremely valu- 
able in development of an experimental plan. 

The central premise of the approach described in this section is that learning 
is, by its very nature, a sequential process. The experimenter, be it an individual 
or a team, begins with relatively little specific knowledge and proceeds to gain 
knowledge by conducting experiments on the process. As new knowledge is 
acquired, the learner is better able to determine which step is most appropriate 
to take next. In other words, experimentation always involves guesswork; 
but guesses become more educated as experimental data become available for 
analysis. 

This approach is in contrast to the classical approach where an effort is 
made to answer all conceivably relevant questions in one large experiment. 
The classical approach to experimentation was developed primarily for 
agricultural experiments. Six Sigma applications are unlike agricultural 
applications in many ways, especially in that results become available quickly. 
The approach described here takes advantage of this to accelerate and direct 
learning. 

We will use an example from electronic manufacturing. At the outset, a team 
of personnel involved in a soldering process received a mission from another 
team that had been evaluating problems for the factory as a whole. The factory 
team had learned that a leading reason for customer returns was solder pro- 
blems. Another team discovered that the solder area spent more resources in 
terms of floor space than other areas; a major usage of floor space was for the 
storage of defective circuit boards and the repair of solder defects. Thus, the 
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solder process improvement team was formed and asked to find ways to elimi- 
nate solder defects if possible, or to at least reduce them by a factor of 10. 
Team members included a Six Sigma technical leader, a process engineer, an 
inspector, a production operator, and a product engineer. 

The team spent several meetings reviewing Pareto charts and problem 
reports. It also performed a process audit which uncovered several obvious 
problems. When the problems were repaired the team conducted a process 
capability study, which revealed a number of special causes of variation, which 
were investigated and corrected. Over a four-month period, this preliminary 
work resulted in a 50% reduction in the number of solder defects, from about 
160 defects per standard unit to the 70-80 defect range. The productivity of the 
solder area nearly doubled as a result of these efforts. While impressive, the 
results were still well short of the 10Xminimum improvement the team was 
asked to deliver. 


Phase I: The screening experiment 
“WHAT'S IMPORTANT HERE?” 


At this point the process was stable and the team was ready to move from 
the process control stage to the process improvement stage. This involved 
conducting designed experiments to measure important effects. The solder 
team decided to list as many items as possible that might be causing solder 
problems. Since many variables had already been studied as part of the Phase 
0 work, the list was not unreasonably long. The team looked at ways to 
control the variables listed and was able to develop methods for eliminating 
the effects of many variables on their list. The remaining list included the 
following factors: 


VARIABLE LOW LEVEL (-) | HIGH LEVEL (+) 

A: Pre-baking of boards in an oven No Yes 

B: Pre-heat time 10 seconds 20 seconds 

C: Pre-heat temperature 150°F 

D: Distance from pre-heat element to board 25cm 50cm 
surface 

E: Line speed 3fpm 5 fpm 

F: Solder temperature 495°F 505°F 

G: Circuit density Low High 

H: Was the board in a fixture? No Yes 
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This information was used to create an experimental design using a statistical 
software package. There are many packages on the market that perform similar 
analyses to the one shown here. 

Since this is only to be a screening experiment, the team was not interested in 
obtaining estimates of factor interactions. The focus was to identify important 
main effects. The software allows selection from among several designs. The 
Black Belt decided upon the design which would estimate the main effects 
with the smallest number of test units. This design involved testing 16 units. 
The data matrix produced by the computer is shown in Table 17.7. The run 
order has been randomized by the computer. If the experiment cannot be con- 
ducted in that particular order, the computer software would allow the data to 
be run in blocks and it would adjust the analysis accordingly. The program 
also tells us that the design is of resolution IV, which means that main effects 
are not confounded with each other or any two-factor interactions. 


Table 17.7. Screening experiment layout. Data matrix (randomized). 


RUN | A B G D E RESPONSE 
1 + = - - - 65 
2 + — Ly + = 85 
3 - + — — oF 58 
4 - + - - + 57 
5 63 
6 + + + + + 75 
7 os + = + = 
8 = + + = 
9 + = + be + 

10 + + + + - 56 
1 = = + = + + + = 63 
12 + + + Z + 81 
13 + + - + + 73 
14 + — = + + S + = 87 
15 a + eg Fi 75 
16 — — + + — + + 84 
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In Table 17.7 the “—” indicates that the variable is run at its low level, while a 
“+” sion indicates that it is to be run at its high level. For example, the unit for 
run #16 was processed as follows: 

Y Pre-baking = No 

Y Pre-heat time = 10 seconds 
Pre-heat temperature = 200 degrees F 
Distance from pre-heat element to board surface = 50 cm 
Line speed = 3 fpm 
Solder temperature = 495 degrees F 
Circuit density = High 
Fixture used = Yes 

v Defects per standard unit = 84 

Experimental data were collected using the randomized run order recom- 
mended by the software. The “response” column are data that were recorded 
in terms of defective solder joints per “standard unit,” where a standard unit 
represented a circuit board with a median number of solder joints.” The results 
are shown in Table 17.8. 

A model that fits the data well would produce residuals that fall along a 
straight line. The Black Belt concluded that the fit of the model was adequate. 

The analysis indicates that factors B (pre-heat time) and D (distance from 
pre-heat element to board surface) produce significant effects. Figure 17.3 
shows a normal probability plot of the experimental effects. This figure plots 
the coefficients column from Table 17.8 on a normal probability scale. If the 
factor’s effect was due to chance variation it would plot close to the line 
representing normal variation. In Figure 17.4 the effects of B and D are shown 
to be further from the line than can be accounted for by random variation. 

The effects of the significant factors are graphed in response units in Figure 
17.4. 

Since the response is a defect count, the graph indicates that the low level of 
factor D gives better results, while the high level of factor B gives the better 
results. This can also be seen by examination of the coefficients for the variables. 
When D is low the average defect rate is 18.5 defects per unit better than when 
D is high; when B is high the average defect rate is 8 defects per unit better 
than when B is low. 

The team met to discuss these results. They decided to set all factors that were 
not found to be statistically significant to the levels that cost the least to operate, 


K 44 4 48K 


*Technically, a Poisson model would be the correct choice here. However, use of anormal model, which the analysis assumes, 
is reasonably accurate for defect counts of this magnitude. The team also evaluated the variance, more specifically, the log 


of the variance. The variances at each factor combination did not differ significantly and are not shown here. 
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Table 17.8. Results of experimental data analysis. Fractional factorial fit. 


Estimated effects and coefficients for response (coded units) 


Term Effect Coef StDev coef ae P 

Constant 70.375 0.6597 106.67 0.000 
A —0.750 —0.375 0.6597 —0.57 0.588 
B 8.000 4.000 0.6597 6.06 0.001 
C —0.500 —0.250 0.6597 —0.38 0.716 
D —18.500 —9.250 0.6597 | —14.02 0.000 
E 0.000 0.000 0.6597 0.00 1.000 
F —0.250 —0.125 0.6597 —0.19 0.855 
G —0.250 —0.125 0.6597 —0.19 0.855 
H 0.250 0.125 0.6597 0.19 0.855 


ANOVA for defects (coded units) 


Source of variation df Seq. SS Adj. SS Adj.MS| F _ | P-value 
Main effects 8 1629.00 1629.00 203.625 | 29.24 0.000 
Residual error 7 48.75 48.75 6.964 

Total 15 1677.75 


Normal Probability Plot of the Residuals 
(Response is Defects) 


Normal Score 


] | | 
4 0 1 2 


Standardized Residual 


Figure 17.3. Residuals from experimental model. 
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Normal Probability Plot of the Standardized Effects 
(Response is Defects, Alpha = .10) 


Normal Score 


Standardized Effect 


Figure 17.4. Significant factor effects. 


and factors Band Dat their midpoints. The process would be monitored at these 
settings for a while to determine that the results were similar to what the team 
expected based on the experimental analysis. While this was done, another ser- 
ies of experiments would be planned to further explore the significant effects 
uncovered by the screening experiment. 


Phase Il: Steepest ascent (descent) 
“WHICH WAY IS UP?” 


Based on the screening experiment, the linear model for estimating the defect 
rate was found from the coefficients in Table 17.8 to be 


Defect Rate = 70.375 + 4B — 9.25D (17.2) 


The team wanted to conduct a series of experiments to evaluate factors B and 
D. The Phase I experiment reveals the direction and ratio at which B and D 
should be changed to get the most rapid improvement in the defect rate, i.e., 
the direction of steepest ascent (where “ascent” means improvement in the 
measurement of interest). To calculate a series of points along the direction of 
steepest ascent, start at the center of the design and change the factors in pro- 
portion to the coefficients of the fitted equation; i.e., for every 4 unit increase 
in factor B we decrease factor D 9.25 units. For the data at hand, the center of 
the experiment and unit sizes are shown in Table 17.9. 
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Table 17.9. Unit sizes and center of experiment. 


FACTOR UNIT SIZE CENTER 
B 5 15 seconds 


D 12.5 37.5cm 


A test unit was produced at the center value of B and D. The team decided 
that they would reduce the pre-heat time (B) in increments of 5 seconds (1 
unit), while lowering the distance from the heating element (D) by increments 
of (9.25/4) x 12.5cm = 28.9 cm. This resulted in a single experiment where B 
= 20 seconds, D = 8.6 cm. The result was 52 defects per unit. However, despite 
the improved solder defect performance, the team noted that at the short dis- 
tance the board was beginning to scorch. This necessitated that the team aban- 
don the steepest ascent path. They conducted a series of experiments where 
board scorching was examined at different distances to the pre-heating element 
(factor D) and determined that a distance of at least 15 cm was required to be 
confident they would avoid scorching. To allow a margin of safety, the team 
set the distance D at 20 cm. They then proceeded to increase pre-heat time in 5 
second intervals, producing one board at each pre-heat setting. The results are 
shown in Table 17.10. 

These data are presented graphically in Figure 17.5. 


Table 17.10. Data for experiments on path of steepest descent. 


B D AVERAGE 
RUN (sec.) (cm) DEFECTS 
1 15 37.5 70 
2 20 8.75 52 
3 25 20 51 
4 30 20 31 
5 35 20 18 
6 40 20 12 
7 45 20 10 
8 50 20 13 
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Figure 17.5. Steepest descent results. 


With the distance fixed at 20 cm from the pre-heat element to the board sur- 
face, the best results were obtained with a pre-heat time of 40 seconds. Beyond 
that the defect rate was greater. 


Phase Ill: The factorial experiment 

The team decided to conduct a factorial experiment near the best settings to 
explore that experimental region more thoroughly. To do so, they decided to 
run a factorial experiment which would allow them to estimate the two-factor 
BD interaction as well as the main effects. They also wished to determine if 
there was any “curvature” in the area. This required that more than two levels 
be explored (only linear estimates are possible with two-level designs). Finally, 
the team wanted to obtain an estimate of the experimental error in the region; 
this required replicating the experiment. The design selected is shown in Table 
17.11. 

Code numbers used for the computer are shown in parentheses. The runs 
marked 0, 0 are center points. Note that each combination (ie., set of plus and 
minus signs or zeros) is repeated three times. The team decided to center the 
design at the B value found to be steepest, B = 45 seconds. The interval for D 
was reduced to 2.5 cm and the experiment was centered one interval above 
D = 20(ie., at D = 22.5) (Table 17.12). 
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Table 17.11. Replicated full-factorial design with center points. 


RUN B D 
1 40 (1) 20.0 (-1) 
2 45 (0) 22.5 (0) 
0-1 
5 50 (1) 20.0 (-1) 
5(0) 
7 40 (-1) 
8 40 (-1) 25.0 (1) 
10 50(1) 25.0(1) 
11 40 (-1) 20.0 (1) 
12 40 (-1) 20.0 (1) 
13 50(1) 25.0 ( 1) 
14 50(1) 20.0 (—1) 
15 45 (0) 22.5 (0) 
FRACTIONAL FACTORIAL FIT 
Estimated effects and coefficients for defects (coded units) 
Term Effect Coef StDev coef ‘x P. 
Constant 12.583 0.2357 53.39 | 0.000 
A ~2.833 —1.417 0.2357 6.01 | 0.000 
B 1.500 0.750 0.2357 3.18 | 0.010 
A‘B ~1.833 ~0.917 0.2357 —3.89 | 0.003 
Ct Pt ~2.917 0.5270 —5.53 | 0.000 


Looking at the P column all terms in the model are significant (any P value 
below 0.05 indicates a significant effect). This analysis is confirmed by the 


ANOVA table (Table 17.13). 
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Table 17.12. Results of full factorial experiment with center points and replicates. 


RUN B D RESULT 
1 40 (—1) 20.0 (—1) 11 
2 45 (0) 22.5 (0) 9 
3 50 (1) 25.0 (1) 11 
4 40 (—1) 25.0 (1) 15 
5 50 (1) 20.0 (—1) 12 
6 45 (0) 22.5 (0) 10 
4 40 (—1) 25.0(1) 17 
8 40 (—1) 25.0 (1) 15 
9 50 (1) 20.0 (—1) 11 
10 50 (1) 25.0 (1) 11 
11 40 (—1) 20.0 (—1) 13 
12 40 (—1) 20.0 (1) 13 
13 50 (1) 25.0 (1) 11 
14 50 (1) 20.0 (—1) 11 
15 45 (0) 22.5 (0) 10 


Table 17.13. ANOVA for factorial experiment with center points. 


ANOVA for defects (coded units) 


Source of variation 


Main effects 2 30.833 30.833 15.4167 23.13 | 0.000 
2-way interactions 1 10.083 10.083 10.0833 15.13 | 0.003 
Curvature 1 20.417 20.417 20.4167 30.63 | 0.000 
Residual error 10 6.667 6.667 0.6667 

Pure error 10 6.667 6.667 0.6667 

Total 14 68.000 


Looking at the P column of the ANOVA table, we see that main effects, the 
two-way interaction, and “curvature” are all significant (P < 0.05). Curvature 
is measured by comparing the average response at the center points with the 
responses at the corner points of the design. The fact that curvature is significant 
means that we are no longer experimenting in a linear region of the responses. 
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This means that our original coefficients, which were based on the linear model, 
are no longer adequate. Upon seeing these results, the Black Belt decided that 
it was necessary to proceed to Phase IV to better investigate the response region 
and to try to locate a stationary optimum. 


Phase IV: The composite design 


The Black Belt decided to try using a design known as a composite design or 
central composite design to obtain additional information on the region where 
the process was operating. This design involves augmenting the corner points 
and center point of the previous factorial experiment with additional points, as 
shown in Figure 17.6. The points extend the design beyond the levels previously 
designed by the high and low values for each factor. The team decided that 
they could allow the distance to be decreased somewhat below the 20 cm “mini- 
mum” distance because they had added a 5 cm margin of safety. They also 
noted that they were now taking relatively small experimental steps compared 
to the large jumps they took during steepest ascent. 
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Figure 17.6. Central composite design for solder process. 
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DOE software finds the coefficients of the equation that describes a complex 
region for the responses. The equation being fitted is: 


y= Bo pia Pop Bue a Boe + Byx1xX. +€ (17.3) 


The region described by this equation may contain a maximum, a 
minimum, or a “saddle point.” At a maximum any movement away from 
the stationary point will cause the response to decrease. At the minimum 
any movement away from the stationary point will cause the response to 
increase. At a saddle point moving away from the stationary value of one 
variable will cause a decrease, while moving away from the stationary value 
of the other variable will cause an increase. Some DOE software will tell 
you the values of X and Y at the stationary point, and the nature of the 
stationary point (max, min, or saddle). Other DOE software display two- 
dimensional and three-dimensional drawings that graphically describe the 
region of experimentation. It is usually not difficult to interpret the response 
surface drawings. 

The data collected by the team are shown in Table 17.14. Note that the data 
are shown in standard order, but the run order was random. 


Table 17.14. Central composite design experiment and data. 


B D DEFECTS 
—1.41421 0.00000 16 
1.00000 1.00000 11 
0.00000 0.00000 9 
0.00000 —1.41421 11 
1.00000 —1.00000 
1.41421 0.00000 
0.00000 0.00000 10 
0.00000 0.00000 10 
0.00000 1.41421 15 
0.00000 0.00000 9 
0.00000 0.00000 10 
—1.00000 1.00000 15 
—1.00000 —1.00000 13 
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The computer analysis of these data is shown in Table 17.15. 


Table 17.15. Analysis of central composite design. 
Estimate regression coefficients for Y. 


Estimated regression coefficients for defects 

Term Coef StDev coef ‘i P 

Constant 9.600 0.5880 16.326 0.000 
B —3.121 0.4649 —6.714 0.000 
D 1.207 0.4649 2.597 0.036 
B*B 0.325 0.4985 0.652 0.535 
D*D 1.825 0.4985 3.661 0.008 
B*D 0.000 0.6574 0.000 1.000 

S = 1.315 R—Sq = 90.3% R—Sq(adj) = 83.4% 


mars 2 : F 
The P-values indicate that all terms except the B* term and the interaction 
term are significant. 


ANOVA for defects 


Source of variation 


Regression 5 112.821 112.8211 22.5642 13.05 0.002 
Linear 2 89.598 89.5980 44.7990 25.91 0.001 
Square 2 23.223 23.2231 11.6115 6.72 0.024 
Interaction 1 0.000 0.0000 0.0000 0.00 1.000 
Residual Error 7 12.102 12.1020 1.7289 

Lack-of-Fit 3 10.902 10.9020 3.6340 12.11 0.018 
Pure Error 4 1.200 1.2000 0.3000 

Total 12 124.923 


Unusual observations for defects 
Observation Defects Fit StDev Fit | Residual | St Resid 


6 4.000 5.836 1.039 —1.836 —2.28R 


R denotes an observation with a large standardized residual. The team 
confirmed the defect count for observation #6. 
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The ANOVA indicates that the lack of fit is significantly greater than pure 
error. However, the Black Belt felt the magnitude of the lack of fit was tolerable. 
It also indicates that the interaction term is not significant and could be 
removed from the model, gaining a degree of freedom for estimating the error. 

The response surface 3D and contour plots are shown in Figure 17.7a and 
17.7: 


Defects 


Figure 17.7a. Response surface plot for defect data. 


Contour Plot of Defects 
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Figure 17.7b. Contour plot for defect data. 
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The analysis could become somewhat more advanced if the Black Belt chose 
to perform acanonical analysis to investigate the nature of the response surface 
in greater detail. Canonical analysis involves finding a stationary point S and 
performing a coordinate system transformation to eliminate the cross-product 
and first order terms. The techniques for performing this analysis are described 
in a number of advanced texts (Box and Draper, 1987; Meyers and 
Montgomery, 1995). However, it is obvious from the contour plot and the 3D 
response surface plot that there may still be some room to improve by holding 
D constant and gradually increasing B. 

At this point the team decided that they had reached a point of diminishing 
returns as far as the current process is concerned. The data indicate that the 
existing process for wave solder can, if properly controlled, manage to produce 
10 or fewer defects per standard unit at the center of the last design. This is 
about 16 times better than the process was producing at the outset of the project 
and about 7 times better than the average result of the first experiment. 

The team, guided by the Black Belt, decided to set the process at the center 
point of the last experiment (B =0, D=0) and to implement Evolutionary 
Operation (EVOP) to pursue further optimization. EVOP involves running a 
series of designed experiments on production units, with operating personnel 
making small changes (Box and Draper, 1969). By restricting EVOP to small 
process changes the risk of producing scrap is reduced. Although the move- 
ments in process settings are small, the cumulative improvement in per- 
formance can be substantial. The apparent gradual slope of the defect rate in 
the +B direction also made it unlikely that the process would “fall off of a 
cliff” during EVOP. 

The Black Belt helped set up EVOP on the process and train supervisory and 
hourly personnel in its use. She also agreed to provide ongoing support in the 
form of periodic visits and availability should questions arise. The team decided 
that after turning over process improvement to operating personnel, they 
would look at ways of maintaining their gains, while simultaneously investigat- 
ing basic process and product design changes to obtain further improvement. 


Phase V: Robust product and process design 


Maintaining gains involves, among other things, creating processes and pro- 
ducts that operate close to their optimum conditions even when changes 
occur. Robust design can begin with careful study of the contour plot. Note 
that if you start at B= D =0 and move from along a line from left to right the 
response changes relatively slowly. However, if you move from the center 
along a line from lower to upper, the defect rate increases rapidly. Robust pro- 
cess control planning should take such non-linearity into account. If there is a 
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need to change factor B or D, they should be changed in a way that avoids 
increasing the defect rate. This does mot mean that all changes should be for- 
bidden; after all, without change there can be no learning or improvement. 
However, changes should be monitored (as with EVOP) to provide a filter 
between the customer and the production of non-conforming product that 
may occur during the learning process. 

More formally, robust design can be integrated into experimental design. The 
methods described by Genichi Taguchi are a well-known approach to integrat- 
ing DOE and product and process design. While there has been much criticism 
of Taguchi’s statistical approach, there is a broad consensus that his principles 
of robust parameter design are both valid and valuable contributions to Six 
Sigma analysis. 


TAGUCHI ROBUSTNESS CONCEPTS 


This section will introduce some of the special concepts introduced by Dr. 
Genichi Taguchi of Japan. A complete discussion of Taguchi’s approach to 
designed experiments is beyond the scope of this book. However, many of 
Taguchi’s ideas are useful in that they present an alternative way of looking at 
quality in general. 


Introduction 

Quality is defined as the loss imparted to the society from the time a product 
is shipped (Taguchi, 1986). Taguchi divides quality control efforts into two cate- 
gories: on-line quality control and off-line quality control. 

On-line quality control—involves diagnosis and adjusting of the process, 
forecasting and correction of problems, inspection and disposition of 
product, and follow-up on defectives shipped to the customer. 

Off-line quality control—quality and cost control activities conducted at 
the product and the process design stages in the product development 
cycle. There are three major aspects to off-line quality control: 

1. System design—is the process of applying scientific and engi- 
neering knowledge to produce a basic functional prototype design. 
The prototype model defines the initial settings of product or 
process design characteristics. 

2. Parameter design—is an investigation conducted to identify set- 
tings that minimize (or at least reduce) the performance variation. 
A product or a process can perform its intended function at many 
settings of its design characteristics. However, variation in the per- 
formance characteristics may change with different settings. This 
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variation increases both product manufacturing and lifetime costs. 
The term parameter design comes from an engineering tradition 
of referring to product characteristics as product parameters. An 
exercise to identify optimal parameter settings is therefore called 
parameter design. 

3. Tolerance design—is a method for determining tolerances that 
minimize the sum of product manufacturing and lifetime costs. 
The final step in specifying product and process designs is to deter- 
mine tolerances around the nominal settings identified by para- 
meter design. It is still a common practice in industry to assign 
tolerances by convention rather than scientifically. Tolerances 
that are too narrow increase manufacturing costs, and tolerances 
that are too wide increase performance variation and the lifetime 
cost of the product. 


Expected loss—the monetary losses an arbitrary user of the product is likely 


to suffer at an arbitrary time during the product’s life span due to per- 
formance variation. Taguchi advocates modeling the loss function so 
the issue of parameter design can be made more concrete. The most 
often-used model of loss is the quadratic loss function illustrated in 
Figure 17.8. Note that the loss from operating the process is found by 
integrating the process pdf over the dollar-loss function. Under this 
model there is always a benefit to 
1. moving the process mean closer to the target value, 
2. reducing variation in the process. 

Of course, there is often a cost associated with these two activities. 

Weighing the cost/benefit ratio is possible when viewed from this 
perspective. 

Note the contrast between the quadratic loss function and the con- 
ceptual loss function implicit in the traditional management view. The 
traditional management approach to loss is illustrated in Figure 17.9. 

Interpretation of Figure 17.9: there is no loss as long as a product or 
service meets requirements. There is no “target” or “optimum”: just 
barely meeting requirements is as good as operating anywhere else 
within the zone of zero loss. Deviating a great deal from requirements 
incurs the same loss as being just barely outside the prescribed range. 
The process distribution is irrelevant as long as it meets the require- 
ments. 

Note that under this model of loss there is no incentive for improv- 
ing a process that meets the requirements since there is no benefit, ie., 
the loss is zero. Thus, cost > benefit for any process that meets require- 
ments. This effectively destroys the idea of continuous improvement 
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Figure 17.8. Taguchi’s quadratic loss function. 
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Figure 17.9. Traditional approach to loss. 
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and leads to the acceptance of an “acceptable quality level” as an oper- 
ating standard. 


Noise—the term used to describe all those variables, except design para- 


meters, that cause performance variation during a product’s life span 
and across different units of the product. Sources of noise are classified 
as either external sources or internal sources. 


External sources of noise—variables external to a product that affect the 


product’s performance. 


Internal sources of noise—the deviations of the actual characteristics of a 


manufactured product from the corresponding nominal settings. 


Performance statistics—estimate the effect of noise factors on the perfor- 


mance characteristics. Performance statistics are chosen so that maxi- 
mizing the performance measure will minimize expected loss. Many 
performance statistics used by Taguchi use “signal to noise ratios” 
which account jointly for the levels of the parameters and the variation 
of the parameters. 


Summary of the Taguchi method 
The Taguchi method for identifying settings of design parameters that 
maximize a performance statistic is summarized by Kackar (1985): 


Identify initial and competing settings of the design parameters, and iden- 
tify important noise factors and their ranges. 

Construct the design and noise matrices, and plan the parameter design 
experiment. 

Conduct the parameter design experiment and evaluate the performance 
statistic for each test run of the design matrix. 

Use the values of the performance statistic to predict new settings of the 
design parameters. 

Confirm that the new settings do indeed improve the performance statis- 
tic. 


DATA MINING, ARTIFICIAL NEURAL NETWORKS AND 
VIRTUAL PROCESS MAPPING 


As beneficial and productive as design of experiments can be, the process of 
conducting them has its drawbacks. The workplace, be it a factory, a retail estab- 
lishment or an office, is designed around a routine. The routine is the “real 
work” that must be done to generate the sales which, in turn, produce the reven- 
ues that keep the enterprise in existence. By its very nature, experimenting 
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means disrupting the routine. Important things are changed to determine what 
effect they have on various important metrics. Often, these effects are un- 
pleasant; that’s why they weren’t changed in the first place! The routine was 
often established to steer a comfortable course that avoids the disruption and 
waste that results from making changes. 

The problem is, without change things can never improve. Six Sigma gen- 
erates as much improvement by changing things as it does by reducing vari- 
ability. 

In this section we present a way of conducting “virtual” experiments using 
existing data and artificial neural network (neural net) software. Neural nets 
are popular because they have a proven track record in many data mining and 
decision-support applications. Neural nets are a class of very powerful, general 
purpose tools readily applied to prediction, classification, and clustering. They 
have been applied across a broad range of industries from predicting financial 
series to diagnosing medical conditions, from identifying clusters of valuable 
customers to identifying fraudulent credit card transactions, from recognizing 
numbers written on checks to predicting failure rates of engines (Berry and 
Linoff, 1997). In this section we explore only the application of neural nets to 
design of experiments for Six Sigma, but this merely scratches the surface of 
the potential applications of neural nets for quality and performance improve- 
ment. 

Neural networks use a digital computer to model the neural connections in 
human brains. When used in well-defined domains, their ability to generalize 
and learn from data mimics our ability to learn from experience. However, 
there is a drawback. Unlike a well-planned and executed DOE, a neural net- 
work does not provide a mathematical model of the process.” For the most 
part, neural networks must be approached as black boxes with mysterious inter- 
nal workings, much like the mystery of the human mind it is designed to imitate. 

All companies record important data, some in well-designed data ware- 
houses, some in file drawers. These data represent potential value to the Six 
Sigma team. They contain information that can be used to evaluate process per- 
formance. If the data include information on process settings, for example, 
they may be matched up to identify possible cause and effect relationships and 
point the direction for improvement. The activity of sifting through a database 
for useful information is known as data mining. The process works as follows: 


“Tt is possible, however, to include various transformed variables to “help” the neural net if one has a model in mind. For 
example, in addition to feeding the neural net X1 and X2 raw data, one could include higher-order polynomial and interaction 


terms as inputs to the neural network. 
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1. Create a detailed inventory of data available throughout the organiza- 
tion. 

2. Determine the variables which apply to the process being improved. 

3. Using a subset of the data which include the most extreme values, train 
the neural net to recognize relationships between patterns in the inde- 
pendent variables and patterns in the dependent variables. 

4. Validate the neural net’s predictive capacity with the remaining data. 

5. Perform experimental designs as described in the section above entitled 
“Empirical model building and sequential learning.” However, instead 
of making changes to the actual process, make changes to the “virtual 
process” as modeled by the neural net. 

6. Once Phase IV has been completed, use the settings from the neural net 
as a starting point for conducting experiments on the actual process. In 
other words, begin experimenting at Phase I with a screening experi- 
ment. 

It can be seen that the entire soft experimentation process is part of Phase 0 in 
the empirical model building process. It helps answer the question “Where are 
we?” It is important to recognize that neural net experiments are not the same 
as live experiments. However, the cost of doing them is minimal compared 
with live experiments and the process of identifying input and output variables, 
deciding at which levels to test these variable, etc. will bear fruit when the team 
moves on to the real thing. Also, soft experiments allow a great deal more 
“what if?” analysis, which may stimulate creative thinking from team members. 


Example 


The data in Table 17.16 are from the solder process described above. Data 
were not gathered for a designed experiment, but were merely collected during 
the operation of the process. The data were used to train and validate a neural 
net. 

The neural net model is shown in Figure 17.10. 

The model was trained using the above data, producing the process map 
shown in Figure 17.11. 

You can see that the surface described by the neural net is similar to the one 
modeled earlier using DOE. Both models direct the B and D settings to similar 
levels and both make similar predictions for the defect rate. 

The neural net software also allows “what if” analysis. Since these data are 
from the region where the team ran its last phase of experiments, they could be 
used to conduct virtual DOE. The neural net’s What If? contour plot dialog 
box is shown in Figure 17.12. 
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Table 17.16. Solder process data for virtual process mapping. 


PH Time | PH Distance | Defects PH Time | PH Distance | Defects 
15 35 25 20 
13 45 37.5 17 
16 30 20 27 
15 30 22.5 33 
5 30 25 37 
11 30 27.5 50 
50 20 12 30 37.5 57 
42 22.5 10 50 20 13 
50 25 3 50 22.5 5 
42 22 11 50 25 3 
46 22 4 50 30 5 
55 25 4 50 14 12 
55 21 17 50 37.5 14 
55 25 15 50 45 16 
50 24 3 50 50 40 
49 25 3 60 20 35 
57 37 10 60 25 18 
60 37.5 12 


Continued at right ... 
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Figure 17.10. Neural net model for solder defects. 
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Figure 17.11. Neural net process map for solder defects. 
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When PH Distance is 37.000000, and PH lime is 45000000 : 


No change in PH_Distance indicated. 


Figure 17.12. What If? contour plot dialog box. 


The virtual DOE values are entered in the What If? dialog box and the neural 
net’s predictions are used in the experimental design just as if they had been 
obtained using data from a real experiment. If you have data covering the entire 
region of interest, the neural net may bring you very close to the optimum 
settings even before you do your first actual experiment. See Chapter 19 for 
additional information on virtual DOE. 
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CHAPTER 


18 


Maintaining Control After 
the Project 


BUSINESS PROCESS CONTROL PLANNING 


The project has finished successfully! Or has it? You’ve met the project’s 
goals and the customer and sponsor have accepted the deliverables. But don’t 
be too hasty to declare victory. The last battle is yet to be fought. The battle 
against creeping disorder, the battle against entropy. That battle to assure that 
the gains you made are permanent. 


How will we maintain the gains made? 

All organizations have systems designed to assure stability and to protect 
against undesirable change. Often these systems also make it more difficult to 
make beneficial change; perhaps you encountered an example or two while pur- 
suing your Six Sigma project! Still, once you’ve created an improved business 
system these “anti-change” systems can be your friend. Here are some suggested 
ways to protect your hard-won gains. 

Policy changes. Which corporate policies should be changed as a result of 
the project? Have some policies been rendered obsolete? Are new policies 
needed? 

New standards. Did the project bring the organization into compliance 
with a standard (e.g., ISO 9000, environmental standards, product safety 
standards)? If so, having the company adopt the standard might prevent 
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backsliding. Are there any industry standards which, if adopted, would 
help maintain the benefits of the project? Customer standards? ANSI, 
SAE, JCAHO, NCQA, ASTM, ASQ or any other standard-making orga- 
nization standards? Government standards? Don’t forget that compliance 
with accepted standards is often an effective marketing tool; ask your 
marketing people if this is the case and, if so, get their help in adopting 
the standard. 

Modify procedures. Procedures describe the way things are supposed to be 
done. Since the project produced better (different) results, presumably 
some things are being done differently. Be sure these differences are incor- 
porated into formal procedures. 

Modify quality appraisal and audit criteria. The quality control activity in 
an organization exists to assure conformance to requirements. This will 
work for you by assuring that the changes made to documentation will 
result in changes in the way the work is done. 

Update prices and contract bid models. The way product is priced for sale is 
directly related to profit, loss and business success. Because of this, project 
improvements that are embedded in bid models and price models will be 
institutionalized by being indirectly integrated into an array of accounting 
and information systems. 

Change engineering drawings. Many Six Sigma projects create engineer- 
ing change requests as part of their problem solution. For example, when 
a Six Sigma project evaluates process capability it is common to discover 
that the engineering requirements are excessively tight. Perhaps designers 
are using worst-case tolerancing instead of statistical tolerancing. The pro- 
ject team should assure that these discoveries result in actual changes to 
engineering drawings. 

Change manufacturing planning. An organization’s manufacturing plans 
describe in detail how product is to be processed and produced. Often 
the Six Sigma project team will discover better ways of doing things. If 
manufacturing plans are not changed the new and improved approach is 
likely to be lost due to personnel turnovers, etc. For those organizations 
that have no manufacturing plans, the Six Sigma project team should 
develop them, at least for products and processes developed as part of the 
project. Note: this should not be considered scope creep or scope drift 
because it is directly related to the team’s goals. However, it will be better 
still if the team can obtain a permanent policy change to make manufac- 
turing planning a matter of policy (see above). 

Revise accounting systems. Six Sigma projects take a value stream perspec- 
tive of business systems, i.e., a global approach. However, many account- 
ing systems (such as activity based costing) look at local activities in 
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isolation from their place in the overall scheme of things. If kept in place, 
these accounting systems produce perverse incentives that will eventually 
undo all of the good the team has done by breaking the integrated value 
delivery process into a series of competing fiefdoms. Consider changing 
to throughput accounting or other accounting systems better aligned 
with a process and systems perspective. 
Revise budgets. Improvements mean that more can be done with less. 
Budgets should be adjusted accordingly. However, the general rule of free 
markets should also be kept in mind: capital flows to the most efficient. 
Revise manpower forecasts. Toyota’s Taiichi Ohno says that he isn’t inter- 
ested in labor savings, only in manpower savings. In other words, if as a 
result of a Six Sigma project the same number of units can be produced 
with fewer people, this should be reflected in staffing requirements. I 
hasten to point out, however, that research shows that Six Sigma and 
Total Quality firms increase employment at roughly triple the rate of 
non-Six Sigma firms. Greater efficiency, higher quality, and faster cycle 
times allow firms to create more value for customers, thus generating 
more sales. Investors, employees and other stakeholders benefit. 
Modify training. Personnel need to become familiar with the new way of 
doing things. Be sure all current employees are re-trained, and new 
employees receive the proper indoctrination. Evaluate existing training 
materials and revise them as necessary. 
Change information systems. For example, MRP, inventory requirements, 
etc. Much of what occurs in the organization is not touched by humans. 
For example: 
© A purchase order might be issued automatically when inventories for 
a part reach a certain level. However, a Six Sigma project may have 
eliminated the need for safety stock. 
O MRP may generate a schedule based on cycle times rendered obsolete 
by improvements in cycle times. 
When Six Sigma projects change the underlying relationships on which the 
automated information systems are based, programs should be modified to 
reflect this. 


Tools and techniques useful for control planning 

Project planning. Many of the Six Sigma tools and techniques used during 
the define, measure, analyze and improve phases can also be used to 
develop a control plan. Perhaps most important is to keep in mind that 
control planning is a (sub)project. The deliverable is an effective and 
implemented control system. The activities, responsibilities, durations 
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and due dates necessary to produce the deliverable should be carefully 
listed. If the process changes are extensive, the control subproject may 
require another sponsor to take ownership of the control process after 
the team disbands and the main project sponsor accepts the new system. 
A detailed Business Process Change Control Plan should be prepared 
and kept up to date until the Black Belt, sponsor, and process owner are 
confident that the improvements are permanent. 

Brainstorming. The Six Sigma team should brainstorm to expand the list 
presented above with ideas from their own organization. 

Force-field diagram. A force-field diagram can be very useful at this point. 
Show the forces that will push to undo the changes, and create counter- 
forces that will maintain them. The ideas obtained should be used to 
develop a process control plan that will assure that the organization con- 
tinues to enjoy the benefits of the Six Sigma project. 

Process decision program chart. The PDPC is a useful tool in developing a 
contingency plan. 

Failure mode and effect analysis. Using FMEA in the improve phase was 
discussed in detail in Chapter 16, but it is every bit as useful in control 
planning. 


USING SPC FOR ONGOING CONTROL 


Assuming that the organization’s leadership has created an environment 
where open and honest communication can flourish, SPC implementation 
becomes a matter of 1) selecting processes for applying the SPC approach and 
2) selecting variables within each process. This section describes an approach 
to this activity. 


Variable selection 


PREPARING THE PROCESS CONTROL PLAN 


Process control plans should be prepared for each key process. The plans 
should be prepared by teams of people who understand the process. The team 
should begin by creating a flow chart of the process using the process elements 
determined in creating the house of quality (see the QFD discussion in 
Chapter 3). The flow chart will show how the process elements relate to one 
another and it will help in the selection of control points. It will also show the 
point of delivery to the customer, which is usually an important control point. 
Note that the customer may be an internal customer. 
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For any given process there are a number of different types of process ele- 
ments. Some process elements are internal to the process, others external. The 
rotation speed of a drill is an internal process element, while the humidity in 
the building is external. Some process elements, while important, are easy to 
hold constant at a given value so that they do not change unless deliberate action 
is taken. We will call these fixed elements. Other process elements vary of their 
own accord and must be watched; we call these variable elements. The drill rota- 
tion speed can be set in advance, but the line voltage for the drill press may 
vary, which causes the drill speed to change in spite of its initial setting (a good 
example of how a correlation matrix might be useful). Figure 18.1 provides a 
planning guide based on the internal/external and fixed/variable classification 
scheme. Of course, other classification schemes may be more suitable on a 
given project and the analyst is encouraged to develop the approach that best 
serves his or her needs. For convenience, each class is identified with a Roman 
numeral; I = fixed—internal, I] = fixed—external, II] = variable—internal and 
IV = variable—external. 

In selecting the appropriate method of control for each process element, pay 
particular attention to those process elements which received high importance 
rankings in the house of quality analysis. In some cases an important process ele- 
ment is very expensive to control. When this happens, look at the QFD correla- 
tion matrix or the statistical correlation matrix for possible assistance. The 
process element may be correlated with other process elements that are less 
costly to control. Either correlation matrix will also help you to minimize the 
number of control charts. It is usually unnecessary to keep control charts on 
several variables that are correlated with one another. In these cases, it may be 


INTERNAL EXTERNAL 
I Il 
FIXED ¢ Setup approval ¢ Audit 
¢ Periodic audits ¢ Certification 
¢ Preventive maintenance 
il IV 
VARIABLE ¢ Control charts ¢ Supplier SPC 
¢ Mistake-proof product ¢ Receiving inspection 
e Mistake-proof process ¢ Supplier sorting 
¢ Sort the output e Mistake-proof product 


Figure 18.1. Guide to selecting and controlling process variables. 
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possible to select the process element that is least expensive (or most sensitive) 
to monitor as the control variable. 

As Figure 18.1 indicates, control charts are not always the best method of 
controlling a given process element. In fact, control charts are seldom the 
method of choice. When process elements are important we would prefer 
that they not vary at all! Only when this cannot be accomplished econom- 
ically should the analyst resort to the use of control charts to monitor the 
element’s variation. Control charts may be thought of as a control mechan- 
ism of last resort. Control charts are useful only when the element being 
monitored can be expected to exhibit measurable and “random-looking” 
variation when the process is properly controlled. A process element that 
always checks “10” if everything is okay is not a good candidate for control 
charting. Nor is one that checks “10” or “12,” but never anything else. 
Ideally, the measurements being monitored with variables control charts 
will be capable of taking on any value, ie. the data will be continuous. 
Discrete measurement data can be used if it’s not too discrete; indeed, all 
real-world data are somewhat discrete. As a rule of thumb, at least ten 
different values should appear in the data set and no one value should 
comprise more than 20% of the data set. When the measurement data 
become too discrete for SPC, monitor them with checksheets or simple 
time-ordered plots. 

Of course, the above discussion applies to measurement data. Attribute con- 
trol charts can be used to monitor process elements that are discrete counts. 

Any process control plan must include instructions on the action to be taken 
if problems appear. This is particularly important where control charts are 
being used for process control. Unlike process control procedures such as audits 
or setup approvals, it is not always apparent just what is wrong when a control 
chart indicates a problem. The investigation of special causes of variation 
usually consists of a number of predetermined actions (such as checking the fix- 
ture or checking a cutting tool) followed by notifying someone if the items 
checked don’t reveal the source of the problem. Also verify that the arithmetic 
was done correctly and that the point was plotted in the correct position on 
the control chart. 

The reader may have noticed that Figure 18.1 includes “sort the output” as 
part of the process control plan. Sorting the output implies that the process is 
not capable of meeting the customer’s requirements, as determined by a process 
capability study and the application of Deming’s all-or-none rules. However, 
even if sorting is taking place, SPC is still advisable. SPC will help assure that 
things don’t get any worse. SPC will also reveal improvements that may 
otherwise be overlooked. The improvements may result in a process that is 
good enough to eliminate the need for sorting. 
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PROCESS CONTROL PLANNING FOR SHORT AND 
SMALL RUNS 


A starting place for understanding statistical process control (SPC) for short 
and small runs is to define our terms. The question “what zs a short run?” will 
be answered for our purposes as an environment that has a large number of 
jobs per operator in a production cycle, each job involving different product. A 
production cycle is typically a week or a month. A small run is a situation 
where only a very few products of the same type are to be produced. An extreme 
case of a small run is the one-of-a-kind product, such as the Hubble Space 
Telescope. Short runs need not be small runs; a can manufacturing line can pro- 
duce over 100,000 cans in an hour or two. Likewise small runs are not necessarily 
short runs; the Hubble Space Telescope took over 15 years to get into orbit 
(and even longer to get into orbit and working properly)! However, it is possible 
to have runs that are both short and small. Programs such as Just-In-Time inven- 
tory control (JIT) are making this situation more common all of the time. 

Process control for either small or short runs involves similar strategies. Both 
situations involve markedly different approaches than those used in the clas- 
sical mass-production environment. Thus, this section will treat both the small 
run and the short run situations simultaneously. You should, however, select 
the SPC tool that best fits your particular situation. 


Strategies for short and small runs 

Juran’s famous trilogy separates quality activities into three distinct phases 
(Juran and Gryna, 1988): 

e Planning 

¢ Control 

e¢ Improvement 

Figure 18.2 provides a graphic portrayal of the Juran trilogy. 

When faced with small or short runs the emphasis should be placed in the 
planning phase. As much as possible needs to be done before any product is 
made, because it simply isn’t possible to waste time or materials “learning 
from mistakes” made during production. It is also helpful to realize that the 
Juran trilogy is usually applied to products, while SPC applies to processes. It is 
quite possible that the element being monitored with SPC is a process element 
and not a product feature at all. In this case there really is no “short run,” despite 
appearances to the contrary. 

A common problem with application of SPC to short/small runs is that 
people fail to realize the limitations of SPC in this application. Even the use of 
SPC to long production runs will benefit from a greater emphasis on pre- 
production planning. In the best of all worlds, SPC will merely confirm that 
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Planning Control Improvement 


Start production Time 
Figure 18.2. Juran’s trilogy. 
the correct process has been selected and controlled in such a way that it con- 


sistently produces well-designed parts at very close to the desired target values 
for every dimension. 


PREPARING THE SHORT RUN PROCESS CONTROL 
PLAN (PCP) 


Plans for short runs require a great deal of up-front attention. The objective is 
to create a list of as many potential sources of variation as possible and to take 
action to deal with them before going into production. One of the first steps to 
be taken is to identify which processes may be used to produce a given part; 
this is called the “Approved Process List.” Analogously, parts that can be pro- 
duced by a given process should also be identified; this is called the “Approved 
Parts List.” These determinations are made based on process capability studies 
(Pyzdek, 1992a). The approach described in this guide uses process capability 
indices, specifically C,), (the number of standard deviations between the mean 
and the nearest specification limit). The use of this capability index depends on 
a number of assumptions, such as normality of the data etc. Pyzdek (1992b) 
describes the proper use, and some common abuses, of capability indices. 

Because short runs usually involve less than the recommended number of 
pieces the acceptability criteria are usually modified. When less than 50 obser- 
vations are used to determine the capability I recommend that the capability 
indices be modified by using a 440 minimum acceptable process width (instead 
of +30) and a minimum acceptable Chx of 1.5 (instead of 1.33). Don’t bother 
making formal capability estimates until you have at least 20 observations. 
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(You can see in Chapter 12 that these observations need not always be from 20 
separate parts.) 

When preparing for short runs it often happens that actual production parts 
are not available in sufficient quantity for process capability studies. One way 
of dealing with this situation is to study process elements separately and to 
then sum the variances from all of the known elements to obtain an estimate of 
the best overall variance a given process will be able to produce. 

For example, in an aerospace firm that produced conventional guided mis- 
siles, each missile contained thousands of different parts. In any given month 
only a small number of missiles were produced. Thus, the CNC machine shop 
(and the rest of the plant) was faced with a small/short run situation. However, 
it was not possible to do separate pre-production capability studies of each 
part separately. The approach used instead was to design a special test part that 
would provide estimates of the machine’s ability to produce every basic type of 
characteristic (flatness, straightness, angularity, location, etc.). Each CNC 
machine produced a number of these test parts under controlled conditions 
and the results were plotted on a short run X and R chart (these are described 
in Chapter 12). The studies were repeated periodically for each machine. 

These studies provided pre-production estimates of the machine’s ability to 
produce different characteristics. However, these estimates were always better 
than the process would be able to do with actual production parts. Actual pro- 
duction would involve different operators, tooling, fixtures, materials, and 
other common and special causes not evaluated by the machine capability 
study. Preliminary Approved Parts Lists and Preliminary Approved Process 
Lists were created from the capability analysis using the more stringent accept- 
ability criteria described above (C,), at least 1.5 based on a +40 process spread). 
When production commenced the actual results of the production runs were 
used instead of the estimates based on special runs. Once sufficient data were 
available, the parts were removed from the preliminary lists and placed on the 
appropriate permanent lists. 

When creating Approved Parts and Approved Process lists always use the 
most stringent product requirements to determine the process requirement. 
For example, if a process will be used to drill holes in 100 different parts with 
hole location tolerances ranging from 0.001 inches to 0.030 inches, the process 
requirement is 0.001 inches. The process capability estimate is based on its 
ability to hold the 0.001 inch tolerance. 

The approach used is summarized as follows: 

1. Get the process into statistical control. 

2. Set the control limits without regard to the requirement. 

3. Based on the calculated process capability, determine if the most 

stringent product requirement can be met. 
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Process audit 


The requirements for all processes should be documented. A process audit 
checklist should be prepared and used to determine the condition of the pro- 
cess prior to production. The audit can be performed by the operator himself, 
but the results should be documented. The audit should cover known or sus- 
pected sources of variation. These include such things as the production 
plan, condition of fixtures, gage calibration, the resolution of the gaging 
being used, obvious problems with materials or equipment, operator changes, 
and so on. 

SPC can be used to monitor the results of the process audits over time. 
For example, an audit score can be computed and tracked using an individuals 
control chart. 


Selecting process control elements 


Many short run SPC programs bog down because the number of control 
charts being used grows like Topsy. Before anyone knows what is happening 
they find the walls plastered with charts that few understand and no one uses. 
The operators and inspectors wind up spending more time filling out paper- 
work than they spend on true value-added work. Eventually the entire SPC 
program collapses under its own weight. 

One reason for this is that people tend to focus their attention on the product 
rather than on the process. Control elements are erroneously selected because 
they are functionally important. A great fear is that an important product fea- 
ture will be produced out of specification and that it will slip by unnoticed. 
This is a misunderstanding of the purpose of SPC, which is to provide a means 
of process control; SPC is not intended to be a substitute for inspection or test- 
ing. The guiding rule of selecting control items for SPC is: 


SPC control items should be selected to provide a maximum amount of 
information regarding the state of the process at a minimum cost. 


Fortunately most process elements are correlated with one another. Because 
of this one process element may provide information not only about itself, but 
about several others as well. This means that a small number of process control 
elements will often explain a large portion of the process variance. 

Although sophisticated statistical methods exist to help determine which 
groups of process elements explain the most variance, common sense and 
knowledge of the process can often do as well, if not better. The key is to think 
about the process carefully. What are the “generic process elements” that affect 
all parts? How do the process elements combine to affect the product? Do sev- 
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eral process elements affect a single product feature? Do changes in one process 
element automatically cause changes in some other process elements? What 
process elements or product features are most sensitive to unplanned changes? 


EXAMPLE ONE 


The CNC machines mentioned earlier were extremely complex. A typical 
machine had dozens of different tools and produced hundreds of different 
parts with thousands of characteristics. However, the SPC team reasoned that 
the machines themselves involved only a small number of “generic operations”: 
select a tool, position the tool, remove metal, and so on. Further study revealed 
that nearly all of the problems encountered after the initial setup involved only 
the ability of the machine to position the tool precisely. A control plan was cre- 
ated that called for monitoring no more than one variable for each axis of move- 
ment. The features selected were those farthest from the machine’s “home 
position” and involving the most difficult to control operations. Often a single 
feature provided control of more than one axis of movement, for example, the 
location of a single hole provides information on the location of the tool in 
both the X and Y directions. 

Asa result of this system no part had more than four features monitored with 
control charts, even though many parts had thousands of features. Subsequent 
sophisticated multivariate evaluation of the accumulated data by a statistician 
revealed that the choices made by the team explained over 90% of the process 
variance. 


EXAMPLE TWO 


A wave solder machine was used to solder printed circuit boards for a man- 
ufacturer of electronic test equipment. After several months of applying SPC 
the SPC team evaluated the data and decided that they needed only a single 
measure of product quality for SPC purposes: defects per 1,000 solder joints. A 
single control chart was used for dozens of different circuit boards. They also 
determined that most of the process variables being checked could be elimi- 
nated. The only process variables monitored in the future would be flux density, 
solder chemistry (provided by the vendor), solder temperature, and final rinse 
contamination. Historic data showed that one of these variables was nearly 
always out of control when process problems were encountered. Other vari- 
ables were monitored with periodic audits using checksheets, but they were 
not charted. 

Notice that in both of these examples all of the variables being monitored 
were related to the process, even though some of them were product features. 


660 MAINTAINING CONTROL AFTER THE PROJECT 


The terms “short run” and “small run” refer to the product variables only; the 
process is in continuous operation so its run size and duration is neither small 
nor short. 


The single part process 


The ultimate small run is the single part. A great deal can be learned by study- 
ing single pieces, even if your situation involves more than one part. 

The application of SPC to single pieces may seem incongruous. Yet when we 
consider that the “P” in SPC stands for process and not product, perhaps it is 
possible after all. Even the company producing one-of-a-kind product usually 
does so with the same equipment, employees, facilities, etc. In other words, 
they use the same process to produce different products. Also, they usually pro- 
duce products that are similar, even though not identical. This is also to be 
expected. It would be odd indeed to find a company fabricating microchips 
one day and baking bread the next. The processes are too dissimilar. The com- 
pany assets are, at least to a degree, product-specific. 

This discussion implies that the key to controlling the quality of single parts 
is to concentrate on the process elements rather than on the product features. 
This is the same rule we applied earlier to larger runs. In fact, it’s a good rule to 
apply to all SPC applications, regardless of the number of parts being produced! 

Consider a company manufacturing communications satellites. The com- 
pany produces a satellite every year or two. The design and complexity of each 
satellite is quite different than any other. How can SPC be applied at this 
company? 

A close look at a satellite will reveal immense complexity. The satellite will 
have thousands of terminals, silicon solar cells, solder joints, fasteners, and so 
on. Hundreds, even thousands of people are involved in the design, fabrication, 
testing, and assembly. In other words, there are processes that involve massive 
amounts of repetition. The processes include engineering (errors per engineer- 
ing drawing); terminal manufacture (size, defect rates); solar cell manufacture 
(yields, electrical properties); soldering (defects per 1,000 joints, strength); 
fastener installation quality (torque) and so on. 

Another example of a single-piece run is software development. The “part” in 
this case is the working copy of the software delivered to the customer. Only a 
singe unit of product is involved. How can we use SPC here? 

Again, the answer comes when we direct our attention to the underlying pro- 
cess. Any marketable software product will consist of thousands, perhaps mil- 
lions of bytes of finished machine code. This code will be compiled from 
thousands of lines of source code. The source code will be arranged in modules; 
the modules will contain procedures; the procedures will contain functions; 
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and so on. Computer science has developed a number of ways of measuring the 
quality of computer code. The resulting numbers, called computer metrics, 
can be analyzed using SPC tools just like any other numbers. The processes 
that produced the code can thus be measured, controlled and improved. If the 
process is in statistical control, the process elements, such as programmer selec- 
tion and training, coding style, planning, procedures, etc. must be examined. If 
the process is not in statistical control, the special cause of the problem must 
be identified. 

As discussed earlier, although the single part process is a small run, it isn’t 
necessarily a short run. By examining the process rather than the part, improve- 
ment possibilities will begin to suggest themselves. The key is to find the pro- 
cess, to define its elements so they may be measured, controlled, and improved. 


Other elements of the process control plan 


In addition to the selection of process control elements, the PCP should also 
provide information on the method of inspection, dates and results of measure- 
ment error studies, dates and results of process capability studies, subgroup 
sizes and methods of selecting subgroups, sampling frequency, required opera- 
tor certifications, pre-production checklists, notes and suggestions regarding 
previous problems, etc. In short, the PCP provides a complete, detailed road- 
map that describes how process integrity will be measured and maintained. By 
preparing a PCP the inputs to the process are controlled, thus assuring that the 
outputs from the process will be consistently acceptable. 


PRE-CONTROL 


The PRE-Control method was originally developed by Dorian Shainin in the 
1950s. According to Shainin, PRE-Control is a simple algorithm for controlling 
a process based on the tolerances. It assumes the process is producing product 
with a measurable and adjustable quality characteristic which varies according 
to some distribution. It makes no assumptions concerning the actual shape 
and stability of the distribution. Cautionary zones are designated just inside 
each tolerance extreme. A new process is qualified by taking consecutive sam- 
ples of individual measurements until five in a row fall within the central zone 
before two in a row fall into the cautionary zones. To simplify the application, 
PRE-Control charts are often color-coded. On such charts the central zone is 
colored green, the cautionary zones yellow, and the zone outside of the toler- 
ance red. PRE-Control is not equivalent to SPC. SPC is designed to identify 
special causes of variation; PRE-Control starts with a process that is known 
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to be capable of meeting the tolerance and assures that it does so. SPC and pro- 
cess capability analysis should always be used before PRE-Control is applied.” 

Once the process is qualified, it is monitored by taking periodic samples con- 
sisting of two individuals each (called the A,B pair). Action is taken only if 
both A and B are in the cautionary zone. Processes must be requalified after 
any action is taken. 


Setting up PRE-Control 


Figure 18.3 illustrates the PRE-Control zones for a two-sided tolerance (ice., 
a tolerance with both a lower specification limit and an upper specification 


limit). 
RED YELLOW GREEN YELLOW RED 
ZONE I ZONE . ZONE *T zonE "| ZONE 


Low 
Tolerance Limit 
PRE-Control 
Reference Line 
NOMINAL 
DIMENSION 
PRE-Control 
Reference Line 
High 
Tolerance Limit 


Ht ro. I (ioe 


Figure 18.3. PRE-Control zones (two-sided tolerance). 


Figure 18.4 illustrates the PRE-Control zones for a one-sided tolerance (ie., a 
tolerance with only a lower specification limit or only an upper specification 
limit). Examples of this situation are flatness, concentricity, runout and other 
total indicator reading type features. 


* The reader should keep in mind that PRE-Control should not be considered a replacement for SPC. 
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Figure 18.4. PRE-Control zones (one-sided tolerance). 


Figure 18.5 illustrates the PRE-Control zones for characteristics with min- 
imum or maximum specification limits. Examples of this situation are tensile 
strength, contamination levels, etc. In this situation place one reference line a 
quarter of the way from the tolerance limit toward the best sample produced 
during past operations. 


Using PRE-Control 


The first step is setup qualification. To begin, measure every piece produced 
until you obtain five greens in a row. If one yellow is encountered, restart the 
count. If two yellows in a row or any reds are encountered, adjust the process 
and restart the count. This step replaces first-piece inspection. 

After setup qualification you will enter the run phase. Measure two con- 
secutive pieces periodically (the A,B pair). If both are yellow on the same side, 
adjust. If yellow on opposite sides, call for help to reduce the variability of the 
process. If either are red, adjust. In the case of two yellows, the adjustment 
must be made immediately to prevent non-conforming work. In the case of 
red, stop; non-conforming work is already being produced. Segregate all non- 
conforming product according to established procedures. 
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Figure 18.5. PRE-Control zones (minimum/maximum specifications). 


Shainin and Shainin (1988) recommend adjusting the inspection frequency 
such that six A,B pairs are measured on average between each process adjust- 
ment. A simple formula for this is shown in Equation 18.1. 


minutes between measurements = hours between adjustments x 10 
(18.1) 
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Design for Six Sigma (DFSS) 


Design for Six Sigma (DFSS) is a systematic methodology utilizing tools, 
training and measurements to design products and processes that meet custo- 
mer expectations at Six Sigma quality levels. DFSS is deployed via a framework 
known as DMADV—Define-Measure-Analyze-Design-Verify. DMADV, 
which is derived from DMAIC, is a general approach for improving a product, 
service, or process. The DMADV framework is summarized in Table 19.1." 


PRELIMINARY STEPS 


DFSS projects begin with the creation of a project charter. However, a bit of 
fact-finding is required prior to the creation of the charter. If a process already 
exists, the Black Belt needs to become familiar with the way the existing process 
operates to determine if the DMAIC approach or the DFSS approach should 
be used. An excellent way to do this is to observe the operation firsthand. If a 
product or service is involved, observe its use by customers. For example, if the 
process were a call center, have real customers contact the call center and 
observe what happens on both ends of the call. 

If no process exists, consider whether similar processes exist elsewhere and, if 
so, arrange to observe them. Perhaps subprocesses exist at different locations 
and by traveling you can observe some part of what you are trying to create. 


*Note: DFSS is a topic large enough for a book of its own. This chapter provides an overview of the subject. 
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Table 19.1. DMADV framework for DFSS. 


Define 


Define the goals of the design activity 


Measure | Measure customer input to determine what is critical to quality from the 


customers’ perspective. Use special methods when a completely new 
product or service is being designed (see “Beyond customer 
requirements—identifying ‘Delighters’”’ below) 


Analyz 


e | Analyze innovative concepts for products and services to create value for 
the customer 


Design 


Design new processes, products and services to deliver customer value 


Verify 


Verify that new systems perform as expected. Create mechanisms to assure 
continued optimal performance 


Review the section on Benchmarking for pointers on this activity (see Chapter 
2). DFSS is preferred over DMAIC for new process or product design. 

Take some time to summarize your observations, then arrange to meet with 
the business leader to learn the vision for the new process. The gap between 
the current operation and the vision will form the basis of the problem state- 
ment and the business need to be addressed by the project (ie, develop the 
“burning platform” for the project). 

Determine the scope of the project and use this to identify the process bound- 
aries, the process owner, and the sponsor for the project. List the technical, per- 
sonal, and business skills needed to close the gaps, then use this information to 
develop a list of potential team members. Before discussing their involvement 
with their supervisors, speak with the prospects informally to determine if 
they have an interest in participating. Finally, prepare a draft project charter 
and meet with potential sponsors to formalize and finalize the charter. These 
steps are summarized in Figure 19.1. 


ID | Task Name Resource Names 

| |Preliminary 

- Meet with business leader to clarify vision Black Belt,Green Belt, Business Leader 
3 Document problem and business need Black Belt,Green Belt, Business Leader 
s Identify process owner, Sponsor Black Belt,Green Belt,Business Leader 
2 Determine skills required for team Black Belt,Green Belt, Business Leader 
8 Team Selection Black Belt,Sponsor 

ij Train team on selected tools and 6 sigma approach _ ||Black Belt 

. Approve Project charter Sponsor 


Figure 19.1. Preliminary DFSS tasks and resources. 
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DEFINE 


The tasks for the Define and Measure phases are summarized in Figure 19.2. 
The deliverables from the Define phase of a DFSS project are: 

1. List of CTQs 

2. Identify “delighters” (CTQs the customer is not consciously aware of). 


ID_ | Task Name Resource Names 
1° |Define/Measure 

My Identify CTQs Black Belt,Process Owner 
te Create dashboard metrics to operationalize CTQs_ _| Process Owner,Black Belt 
u Establish and validate measurement systems Black Belt 

bs Sponsor Define/Measure gate review Sponsor 


Figure 19.2. Define/measure tasks and responsibilities. 


Identify CTQs 


The define phase of the DMADV project consists primarily of learning what 
is important to the customers. The tools and techniques used to do this are simi- 
lar to those used for DMAIC projects, namely: 

¢ Critical incident technique 

¢ Letters 

¢ Complaints 

e Internet chat rooms, newsgroups and forums 

e Published reviews 
See Chapter 3 for additional information on these topics. 

After going through all of the effort needed to obtain the customer’s input, 
youwill want to be sure to use this information to maintain the voice of the custo- 
mer throughout the design process. Of course, QFD can be used (see Chapter 
3). For another method of linking customer demands to design decisions see 
“Using customer demands to make design decisions” later in this chapter. 


Beyond customer requirements—identifying 
“delighters”’ 


Remember, the goal isn’t to merely satisfy customers, you want to delight 
them with the new design! The discussion of the Kano model, in Chapter 3, 
highlights the importance of this. Delighting the customer requires that you go 
beyond what customers expect to identify things that will pleasantly surprise 
them. My own research has found that you can sometimes accomplish this 
by giving customers more of something they already expect (e.g., a satisfied 
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customer might say “The seat was comfortable,” while the delighted customer 
would say “The seat was extremely comfortable”). However, in many cases 
you'll need to explore feelings that the customer doesn’t even know about, at 
least not on a conscious level. 

Experts in human cognitions point out that, while customers might be able to 
tell us what they think of products and services they are familiar with, they 
really don’t know what it is they want from a mew product or service. These 
experts believe that as much as 95% of all cognition, all the thinking that drives 
customer decisions and behaviors, occurs unconsciously (Zaltman 2002). 
Surveys, focus groups and other approaches that rely on customers telling us 
what they think miss the hidden 95%. A new approach, dubbed ZMET, purports 
to get at the subconscious 95%. The idea behind ZMET is that since people 
think in images and metaphors, their subconscious can be explored by using 
images or metaphors. ZMET begins by asking people a question such as “How 
do you feel about Tylenol compared with generic brands?” 

Rather than verbal or written answers, ZMET asks consumers to spend a 
week or so looking for pictures from any source that capture their feelings 
about the topic. In the example, they would find pictures relating to Tylenol 
and the generic. The pictures are brought to a one-on-one session with an inter- 
viewer who explores with them why they picked the pictures. Often the pictures 
will seem to have nothing at all to do with the subject at hand, but probing ques- 
tions can usually find a connection. Interviews usually take about two hours. 

After interviewing a number of customers, the images are digitized and made 
into acollage representing not the voice of the customer, but the “mind of the cus- 
tomer” or, perhaps, the “heart of the customer.” Usually the customers have 
the same deep feelings about the topic, even though the images may be quite dif- 
ferent. The feelings have major implications on the design decision as well as mar- 
keting decisions. For example, what if the researcher asked customers how they 
felt about computers and discovered that they shared a fear of not being able to 
use the computer after they brought it home. The design would clearly opt fora 
more comfortable look and feel than if the research indicated that the customer 
was excited by the prospect of blazing speed and lots of features. 


Using AHP to determine the relative importance of 
the CTQs* 


This approach is illustrated by an example of a company whose product is a 
personal finance software package. The voice of the customer is: 


* Also discussed in Chapter 3. 
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I want to link a DollarWise total to a report in my word processor. 

[have a high speed connection and Id like to be able to download big data- 
bases of stock information to analyze with DollarWise. 

I like shortcut keys so I don’t have to always click around in menus. 

I only have a 56K connection and DollarWise is slow on it. 

I use the Internet to pay bills through my bank. Id like to do this using 
DollarWise instead of going to my bank’s web site. 

I want an interactive tutorial to help me get started. 

I want printed documentation. 

I want the installation to be simple. 

I want the user interface to be intuitive. 

I want to be able to download and reconcile my bank statements. 

I want to be able to upgrade over the Internet. 

I want to manage my stock portfolio and track my ROI. 

Id like to have the reports I run every month saved and easy to update. 
It’s a pain to set up the different drill downs every time I want to analyze 
my spending. 

It’s clunky to transfer information between DollarWise and Excel. 

When I have a minor problem, I'd like to have easy-to-use self-help avail- 
able on the Internet or in the help file. 

When it’s a problem I can’t solve myself, I want reasonably priced, easy to 
reach technical support. 

You should make patches and bug-fixes available free on the Internet. 


The first step in using this laundry list of comments is to see if there’s an 
underlying structure embedded in them. If these many comments address only 
a few issues, it will simplify the problem of understanding what the customer 
actually wants from the product. While there are statistical tools to help accom- 
plish this task (e.g., structural equation modeling, principal components analy- 
sis, factor analysis), they are advanced and require that substantial data be 
collected using well-designed survey instruments. An alternative is to create an 
“affinity diagram,” which is a simple procedure described elsewhere in this 
book (see Chapter 8). After creating the affinity diagram, the following struc- 
ture was identified: 


A 


Easy to learn. 

1.1. I want the installation to be simple. 

1.2. I want an interactive tutorial to help me get started. 

1.3. I want printed documentation. 

1.4. I want the user interface to be intuitive. 

Easy to use quickly after I’ve learned it well. 

2.1. I like shortcut keys so I don’t have to always click around in 
menus. 
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2.2. 


2.3. 


I'd like to have the reports I run every month saved and easy to 
update. 

It’s a pain to set up the different drill downs every time I want to 
analyze my spending. 


3. Internet connectivity. 


3.1. 


3.2. 
3.3. 


3.4. 
3.5. 


I use the Internet to pay bills through my bank. I'd like to do this 
using DollarWise instead of going to my bank’s web site. 

I only have a 56K connection and Dollar Wise is slow on it. 

I have a high speed connection and Id like to be able to download 
big databases of stock information to analyze with DollarWise. 

I want to be able to download and reconcile my bank statements. 
I want to manage my stock portfolio and track my ROI. 


4. Works well with other software I own. 


4.1. 
4.2, 


It’s clunky to transfer information between DollarWise and Excel. 
Can I link a DollarWise total to a report in my word processor? 


5. Easy to maintain. 


5.1. 
5.2. 


5.3. 


5.4. 


MEASURE 


I want to be able to upgrade over the Internet. 

You should make patches and bug-fixes available free on the 
Internet. 

When I have a minor problem, I'd like to have easy-to-use self-help 
available on the Internet or in the help file. 

When it’s a problem I can’t solve myself, I want reasonably priced, 
easy to reach technical support. 


This structure identifies the CTQs our project will address. The deliverables 
from the Measure phase of a DFSS project are: 

1. Validated metrics for the new process or product 

2. Ameasurement plan 

After the define phase CTQs have been identified, but they are expressed in 
the voice of the customer. In the measure phase CTQs are operationally defined. 
This means that the team establishes specific metrics for each CTQ, in effect 
converting it to an internal requirement. Data sources should be identified or 
created. When using existing data, be sure to consider data quality issues and 
data range issues. That is, are these data suitable for our purposes? Are they 
accurate, reliable, etc.? Do they cover a representative period of time? Etc. 


Also ask 


e¢ What data will I need that do not exist? 

¢ How will I collect them? 

e What sample size will be required? 

e What isa rational subgroup for these data? 
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Since customers are your focus, youneed to determine howyou’ll measure cus- 
tomer satisfaction. You will want to design and conduct surveys and validate the 
results. You may wish to compare satisfaction metrics with those of competitors. 

Finally, a plan should be prepared describing the activities that will be under- 
taken to validate the measurement systems used to collect the metrics. All of 
the usual attributes of measurement systems must be established, i.e., validity, 
accuracy, repeatability, reproducibility, stability, and linearity. In addition, 
you will need to confirm that there is a significant correlation between the 
CTQ and the metric(s) used to measure it. More on this later. 


Measurement plan 


The team should prepare a plan for obtaining the required information when 
the new design becomes operational. The plan should specify the following: 

e What is the operational definition of each metric? 

¢ What data are to be collected? By whom? 

¢ How often will the results be evaluated? By whom? 

e Sample size requirements 

¢ Methods of analysis 


ANALYZE 


The tasks and responsibilities for the Analyze phase of DFSS projects are 
shown in Figure 19.3. 

The Analyze deliverable is the choice of the high level design concept to be 
created. The design is “best” in the sense that it best meets the CTQs. To accom- 
plish this feat we must somehow link the CTQs to features of the design. The 
linkage will be done at a high level. For our example, the customer demand 
model in Figure 19.4 shows that five key categories, or features, are operationa- 


lized by the CTQs. 
ID | Task Name Resource Names 
‘e [Analyze 
ne Link CTQs to design features Process Expert 
a Determine relative and global importance of design features | Black Belt 
2 Benchmark other companies and similar processes Team 
a Define performance standards for CTQs Team 
2 Develop potential design concepts Team,Process Expert 
2 Evaluate concepts and select best design Black Belt 
28 Select most promising design concept Team 
ee Sponsor Analyze gate review Sponsor 


Figure 19.3. DFSS Analyze tasks and responsibilities. 
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Demands 


1.1 Simple Install 


1.2 Interactive Tutorial 


.3. Printed Documentation 


1.4 Intuitive Interface 


2.1 Shortcut Keys 


2.2 Saved Reports 


2.3 Saved Drill Downs 


3.1 Bank 


3.2 56K 


3.3 High speed features 


B.4 Download Reconcile} 


3.5 Manage Portfolio 


4.1 Excel Interface 


4.2 Word Link 


5.1 Internet Upgrades 


5.2 Free Internet Fixes 


5.3 Easy Self Help 


5.4 Good Tech Support 
Value 


Categories 


1. Easy to learn 


2. Easy to use 
after learned 


3. Internet 
Connectivity 


4. Works with 
other software 


5. Easy to 
maintain 


Customer 
Demand 
Model 


es 
Satisfied eas 
Customer Customer 


Figure 19.4. Customer demand model. (Figure 3.17 repeated.) 


The steps taken in the Analyze phase of DFSS are: 
1. Choose a concept design that addresses requirements 


1.1. Map CTQs to design features 


1.2. Identify high level design concepts for implementing features 
1.3. Choose best concept 
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2. Assure that requirements will be consistently met 
2.1. Predict CTQ performance level 
2.2. Compare prediction to requirements 
2.3. Revise design concept as required 

Here’s a summary of what we’ve done up to this point: 


Understand Develop Obtain the 

the project | voice of the 

leadership charter | customer 
vision 


Look at 
existing 
processes 


Customer 
demand 
model. (YOU 
ARE HERE) 


Develop Understand 

CTQs the heart of 
the 
customer 


Determine 
CTQ 


weights 


Choose 
best design 
concept 


Develop Develop Identify 
metrics to systems to design 
operational- measure concepts 
ize CTQs the metrics 


Although great care was taken to maintain the link to the voice of the custo- 
mer, a large number of activities have taken place since we last heard from the 
customer and, most likely, a fair amount of time has passed. It may be that the 
voice of the customer was distorted or lost along the way. You should now 
take the time to make certain that the proposed design concept actually meets 
the customers’ demands. Refer back to your customer demand model (an exam- 
ple was presented in Figure 19.4) and use this information to develop a process 
map based on each proposed design. The demand model shows what the custo- 
mer wants and how we plan to deliver it at a conceptual level. With the design 
proposals in hand, try to determine precisely how the demands are satisfied by 
features of each design. Think of the designs as transfer functions in the 
equation Y =X, +X,+X;+---+X, where Y is a CTQ and the Xs are 
design features. In other words, the ultimate Big Y—overall customer satisfac- 
tion—is an effect that will be caused by the new design (Figure 19.5). 

Use whatever tools and techniques you need to make the connection 
between each Y and the Xs: drawings, photographs, verbal commentary, etc. 
Use SIPOCs to trace activities from the higher level process steps to the actual 
work that needs to be done. The SIPOCs will prove useful when you develop 
operating procedures and work instructions to standardize the process during 


the verify phase. 
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Figure 19.5. The process as a transfer function. 


Using customer demands to make design 
decisions 


Once customers have made their demands known in the Define/Measure 
phase, it is important that these be converted into design requirements and 
specifications. The term “translation” is used to describe this process because 
the activity literally involves interpreting the words in one language (the cus- 
tomer’s) into those of another (the employee). For example, regarding the 
door of her automobile the customer might say “I want the door to close 
completely when I push it, but I don’t want it swinging closed from just the 
wind or when I’m parked on a steep hill.” The engineer working with this 
requirement must convert it into engineering terminology such as pounds of 
force required to move the door from an open to a closed position, the angle 
of the door when it’s opened, and so on. Care must be taken to maintain the 
customers’ intent throughout the development of internal requirements. The 
purpose of specifications is to transmit the voice of the customer throughout 
the organization. 

In addition to the issue of maintaining the voice of the customer, there is the 
related issue of the importance assigned to each demand by the customer. 
Design of products and services always involves tradeoffs: gasoline economy 
suffers as vehicle weight increases, but safety improves as weight increases. 
The importance of each criterion must be determined by the customer. When 
different customers assign different importance to criteria, design decisions 
are further complicated. 
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It becomes difficult to choose from competing designs in the face of ambigu- 
ity and customer-to-customer variation. Add to this the differences between 
internal personnel and objectives—department vs. department, designer vs. 
designer, cost vs. quality, etc-—and the problem of choosing a design alternative 
quickly becomes complex. A rigorous process for deciding which alternative to 
settle on is helpful in dealing with the complexity. 

Next, we must determine importance placed on each item by customers. 
There are a number of ways to do this: 

Have customers assign importance weights using a numerical scale (e.g, 
“How important is “Easy self-help’ on a scale between 1 and 10?”). 

Have customers assign importance using a subjective scale (e.g., unimpor- 
tant, important, very important, etc.) 

Have customers “spend” $100 by allocating it among the various items. In 
these cases it is generally easier for the customer to first allocate the $100 
to the major categories, then allocate another $100 to items within each 
subcategory. The subcategory weights are “local” in that they apply to 
the category. To calculate global weights for subcategory items, divide 
the subcategory weights by 100 and multiply them by the major category 
weight. 

Have customers evaluate a set of hypothetical product offerings and indi- 
cate their preference for each product by ranking the offerings, assigning 
a “likely to buy” rating, etc. The product offerings include a carefully 
selected mix of items chosen from the list of customer demands. The list 
is selected in such a way that the relative value the customer places on 
each item in the offering can be determined from the preference values. 
This is known as conjoint analysis, an advanced marketing technique 
that is described in courses on marketing statistics. 

Have customers evaluate the items in pairs, assigning a preference rating 
to one of the items in each pair, or deciding that both items in a pair are 
equally important. This is less tedious if the major categories are evaluated 
first, then the items within each category. The evaluation can use either 
numeric values or descriptive labels. The pairwise comparisons can be 
analyzed using a method known as the analytic hierarchical process 
(AHP) to determine the relative importance assigned to all of the items. 

All of the above methods have their advantages and disadvantages. We will 
illustrate the use of AHP for our hypothetical software product. AHP is a 
powerful technique that has been proven in a wide variety of applications. In 
addition to its use in determining customer importance values, it is useful 
for decision making in general. Research has shown that people are better 
able to make one-on-one comparisons than to simultaneously compare several 
items. 
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CATEGORY IMPORTANCE WEIGHTS 


We begin our analysis by making pairwise comparison at the top level. The 
affinity diagram analysis identified five categories: easy to learn, easy to use 
quickly after I’ve learned it, Internet connectivity, works well with other soft- 
ware I own, and easy to maintain. Arrange these items in a matrix as shown in 
Figure 19.6. 


Easy to learn 


Compare the relative importance with respect to: Goat: Determine where to focus product upgrade efforts | | Ewes! 


Easy to use quickly after I've learned it 


1 = to lea Easy to use Internet co Works well Easy to me 


Easy to learn 

Easy to use quickly after ve learned it 
internet commectMty 

Works well with other software | own 
Easy to maintain 


40 


Figure 19.6. Matrix of categories for pairwise comparisons. 
Created using Expert Choice 2000 Software, www.expertchoice.com.” 


For our analysis we will assign verbal labels to our pairwise comparisons; the 
verbal responses will be converted into numerical values for analysis. All com- 
parisons are made relative to the customer’s goal of determining which product 
he will buy. The first cell in the matrix compares the “easy to learn” attribute 
and the “easy to use quickly after I’ve learned it” attribute. The customer must 
determine which is more important to him, or if the two attributes are of equal 
importance. In Figure 19.6 this customer indicates that “easy to learn” is moder- 
ately to strongly preferred over “easy to use quickly after I’ve learned it” and 
the software has placed a +4 in the cell comparing these two attributes. (The 
scale goes from —9 to +9, with “equal” being identified as a +1.) The remaining 
attributes are compared one-by-one, resulting in the matrix shown in Figure 
19.7. 


“Although the analysis is easier with special software, you can obtain a good approximation using a spreadsheet. See 
Appendix Table 21 for details. 
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Easy to lea Easy to use internet co Works well Easy to ma 
Easy to learn maa 4.0 10 0 10 
Easy to use quickly after I've learned iit 4 
internet connectivity 10 10 
Works wet with other software | own ; - 
Easy to maintain incor: 0.05 


Figure 19.7. Completed top-level comparison matrix. 


The shaded bars over the attribute labels provide a visual display of the rela- 
tive importance of each major item to the customer. Numerically, the impor- 
tance weights are: 

Easy to learn: 0.264 (26.4%) 

Easy to use quickly after I’ve learned it: 0.054 (5.4%) 
Internet connectivity: 0.358 (35.8%) 

Works well with other software I own: 0.105 (10.5%) 
Easy to maintain: 0.218 (21.8%) 

These relative importance weights can be used in QFD and DFSS as well as 
in the AHP process that we are illustrating here. In our allocation of effort, we 
will want to emphasize those attributes with high importance weights over 
those with lower weights. 


Subcategory importance weights 

The process used for obtaining category importance weights is repeated for 
the items within each category. For example, the items interactive tutorial, 
good printed documentation, and intuitive interface are compared pairwise 
within the category “easy to learn.” This provides weights that indicate the 
importance of each item on the category. For example, within the “easy to 
learn” category, the customer weights might be: 

Interactive tutorial: 11.7% 
Good printed documentation: 20.0% 
Intuitive interface: 68.3% 

If there were additional levels below these subcategories, the process would 
be repeated for them. For example, the intuitive interface subcategory might 
be subdivided into “number of menus,” “number of submenus,” “menu items 
easily understood,” etc. The greater the level of detail, the easier the translation 
of the customer’s demands into internal specifications. The tradeoff is that the 
process quickly becomes tedious and may end up with the customer being 
asked for input he isn’t qualified to provide. In the case of this example, we'd 
probably stop at the second level. 
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GLOBAL IMPORTANCE WEIGHTS 


The subcategory weights just obtained tell us how much importance the item 
has with respect to the category. Thus, they are often called local importance 
weights. However, they don’t tell us about the impact of the item on the overall 
goal, which is called a global impact. This is easily determined by multiplying 
the subcategory item weight by the weight of the category the item belongs to. 
The global weights for our example are shown in Table 19.2 in descending order. 


Using weighted CTQs in decision-making 


The first step in deciding upon a course of action is to identify the goal. For 
example, let’s say you’re the owner of the product development process for a 
company that sells software to help individuals manage their personal finances. 
The product, let’s call it DollarWise, is dominant in its market and your com- 
pany is well respected by its customers and competitors, in large part because 
of this product’s reputation. The business is profitable and the leadership natu- 
rally wants to maintain this pleasant set of circumstances and to build on it for 
the future. The organization has committed itself to a strategy of keeping 
DollarWise the leader in its market segment so it can capitalize on its reputation 
by launching additional new products directed towards other financially 
oriented customer groups, such as small businesses. They have determined 
that product development is a core process for deploying this strategy. 

As the process owner, or Business Process Executive, you have control of the 
budget for product development, including the resources to upgrade the exist- 
ing product. Although it is still considered the best personal financial software 
available, DollarWise is getting a little long in the tooth and the competition 
has steadily closed the technical gap. You believe that a major product upgrade 
is necessary and want to focus your resources on those things that matter most 
to customers. Thus, your goal is: 


Choose the best product upgrade design concept 


The global importance weights are most useful for the purpose of evaluating 
alternative routes to the overall goal. For our example, Internet connectivity 
obviously has a huge customer impact. “Easy to use quickly after I’ve learned 
it” has a low impact. “Easy to learn” is dominated by one item: the user inter- 
face. These weights will be used to assess different proposed upgrade concepts. 
Each concept will be evaluated on each subcategory item and assigned a value 
depending on how well it addresses the item. The values will be multiplied by 
the global weights to arrive at an overall score for the concept. The scores can 
be rank-ordered to provide a list that you, the process owner, can use when 
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Table 19.2. Local and global importance weights. 


LOCAL | GLOBAL 
CATEGORY SUBCATEGORY WEIGHT | WEIGHT 
Intuitive interface 68.3% 18.0% 
Internet connectivity | Online billpay 43.4% 15.5% 
Internet connectivity | Download statements 23.9% 8.6% 
Internet connectivity | Download investment 23.9% 8.6% 
information 
Works well with other | Hotlinks to spreadsheet 75.0% 7.9% 
software 
Easy to maintain Free Internet patches 35.7% 7.8% 
Easy to maintain Great, free self-help technical 30.8% 6.7% 
assistance on the Internet 
Easy to learn Good documentation 20.0% 5.3% 
Easy to maintain Reasonably priced advanced 20.0% 4.4% 
technical support 
Internet connectivity | Works well at 56K 8.9% 3.2% 
Easy to learn Interactive tutorial 11.7% 3.1% 
Easy to maintain Automatic Internet upgrades 13.5% 2.9% 
Works well with other | Edit reports in word processor 25.0% 2.6% 
software 
Easy to use quickly Savable frequently used reports 43.4% 2.3% 
after I’ve learned it 
Easy to use quickly Shortcut keys 23.9% 1.3% 
after I’ve learned it 
Easy to use quickly Short menus showing only 23.9% 1.3% 
after I’ve learned it frequently used commands 
Easy to use quickly Macro capability 8.9% 0.5% 
after I’ve learned it 
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making funding decisions. Or, more proactively, the information can be used to 
develop a concept that emphasizes the most important customer demands. 
Table 19.3 shows part of a table that assesses concepts using the global weights. 
The numerical rating used in the table is 0 = No Impact, 1= Small Impact, 
3 = Moderate Impact, 5 = High Impact. Since the global weights sum to 1 
(100%), the highest possible score is 5. Of the five concepts evaluated, Concept 
C has the highest score. It can be seen that Concept C has a high impact on the 
six most important customer demands. It has at least a moderate impact on 10 
of the top 11 items, with the exception of “reasonably priced advanced technical 
support.” These items account for almost 90% of the customer demands. 


Table 19.3. Example of using global weights in assessing alternatives. 


Great, free self-help technical 


assistance 
Reasonably priced advanced 


Download investment 
technical support 


Plan Customer Impact Score 
Download statements 
information 


Intuitive interface 
Hotlinks to spreadsheet 
Free Internet patches 
Good documentation 
Works well at 56K 
Interactive tutorial 


Online billpay 


ITEM 


GLOBALWEIGHT | 18.0% | 15.5% |8.6% | 8.6% |7.9% |7.8% | 6.7% |5.3% | 4.4% 3.2% | 3.1% 


CONCEPT A | 3.57 3 5 1 1 3 3 4 5 5 > 5 


CONCEPT B | 2.99 1 1 1 3 3 5 5 5 5 5 5 


CONCEPT C | 4.15 5 5 5 5 5 5 3 3 1 3 3 


CONCEPT D | 3.36 3 3 3 3 3 3 3 5 5 P) 5 


CONCEPTE | 2.30 5 0 0 0 5 5 1 1 0) 1 1 


The concept’s customer impact score is, of course, just one input into the 
decision-making process. The rigor involved usually makes the score a very valu- 
able piece of information. It is also possible to use the same process to incorpo- 
rate other information, such as cost, timetable, feasibility, etc. into the final 
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decision. The process owner would make pairwise comparisons of the different 
inputs (customer impact score, cost, feasibility, etc.) to assign weights to them, 
and use the weights to determine an overall concept score. 


Pugh concept selection method 

The Pugh concept selection method is a simple alternative to the above 
approach of evaluating competing design concepts. The Pugh approach utilizes 
a simple matrix diagram to compare alternative concepts (Figure 19.8). One 
concept is dubbed the “baseline” and all others are evaluated relative to the 
baseline. In DMAIC the baseline is the current process. In DMADV, where 
there is no existing process or where the current process is deemed too bad to 
be salvaged, the baseline process is the one found “best” according to some cri- 
terion (e.g., fastest cycle time, lowest cost, fewest errors). If an alternative con- 
cept is better than the baseline with respect to a given criterion, it is given a 
“+” for that criterion. If it is worse it is given a “—.” Otherwise it is considered 
to be the same and given an “S.” Concept scores are found by summing the 
plus and minus signs, providing a count of pros and cons. This is only one 
input into the final choice of concepts, but the structure of the approach stimu- 
lates thought and discussion and usually proves to be very worthwhile. 


Pugh Concept Selection 


Matrix Comparison Criteria 


Concept 2 
Concept 3 
Concept 4 
Concept 5 
Concept 6 
Concept 7 


Baseline 


as 
es 
rom 
® 
Oo 
c 
fo) 
oO 
i 
S) 


Criterion n 


Compare current with selected + = Better Alternative, - = Worse Alternative, S = Same 
alternatives as Baseline 


Figure 19.8. Pugh concept selection matrix. 
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DESIGN 


The term “Design” used in DMADV would more accurately be called 
“Detailed Design.” It is in this phase of the project where the actual product or 
process will be designed. The tasks and responsibilities for the Design phase of 
DEFSS projects are shown in Figure 19.9. 


ID 


26 


27 


28 


29 


30 


31 


32 


33 


34 


35 


Task Name Resource Names 
Design 

Develop detailed design Process Expert, Team 

Predict CTQs Black Belt 

Revise until CTQ predictions meet requirements Team,Process Expert 

Conduct Pilot Process Owner,Process Operator 

Analyze CTQs from Pilot Results Black Belt,Green Belt 

Revise design until pilot CTQs meet requirements Process Expert,Team 

Develop Implementation Plan Team,Process Owner,Process Operator 

Include FMEA Black Belt,Team 
Sponsor Design gate review Sponsor 


Figure 19.9. DFSS Design tasks and responsibilities. 


Process simulation 


Simulation is a means of experimenting with a detailed model of a real system 
to determine how the system will respond to changes in its structure, environ- 
ment or underlying assumptions. A system is defined as a combination of ele- 
ments that interact to accomplish a specific objective. A group of machines 
performing related manufacturing operations would constitute a system. 
These machines may be considered, as a group, an element in a larger produc- 
tion system. The production system may be an element in a larger system invol- 
ving design, delivery, etc. 

Simulations allow the system designer to solve problems. To the extent that 
the computer model behaves as the real world system it models, the simulation 
can help answer important questions. Care should be taken to prevent the 
model from becoming the focus of attention. If important questions can be 
answered more easily without the model, then the model should not be used 

The modeler must specify the scope of the model and the level of detail to 
include in the model. Only those factors which have a significant impact on 
the model’s ability to serve its stated purpose should be included. The level of 
detail must be consistent with the purpose. The idea is to create, as economically 
as possible, a replica of the real-world system that can provide answers to impor- 
tant questions. This is usually possible at a reasonable level of detail. 
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Well designed simulations provide data on a wide variety of systems metrics, 
such as throughput, resource utilization, queue times, and production require- 
ments. While useful in modeling and understanding existing systems, they are 
even better suited to evaluating proposed process changes. In essence, simula- 
tion is a tool for rapidly generating and evaluating ideas for process improve- 
ment. By applying this technology to the creativity process, Six Sigma 
improvements can be greatly accelerated. 


Predicting CTQ performance 
A key consideration for any design concept is the CTQ that would result 
from deploying the design. It is often very difficult to determine what the overall 
result of a series of process steps will be, but relatively easy to study each step 
individually. Software can then be used to simulate the process a number of 
times and then calculate the CTQ at the end of the series. 


EXAMPLE OF PREDICTING CTQ PERFORMANCE 


An order fulfillment process design concept has been studied by benchmark- 
ing each step. Some of the steps were observed internally, while others were 
operating in companies considered best in class for the particular step. The over- 
all CTQ target was to ship within 24 hours of receiving the customer’s call. 
The distribution of the time to complete each of the individual steps is shown 
in Figure 19.10. 

An Excel based computer program” was used to simulate 10,000 orders 
going through the process, producing the results shown in Figure 19.11. The 
simulation indicates that the CTQ Total Cycle Time will be met 99.9% of the 
time, for a process sigma level of 4.6. Since the process goal is 6 sigma, there is a 
gap of 1.4 sigma (about 997 PPM) to be addressed. The distribution of the indivi- 
dual steps provides valuable clues about where to focus our attention. Analysis 
of Figure 19.11 indicates that the problem is a long tail to the right, so we should 
look at steps where this is also the case. “Ship order” and “enter order” are 
both prime suspects and candidates for improvement. A new concept design 
would then be re-simulated. 


*Crystal Ball Professional, www.decisioneering.com. 
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SIMULATION TOOLS 


Not long ago, computer simulation was the exclusive domain of highly 
trained systems engineers. These early simulations were written in some general 
purpose programming language, such as FORTRAN, Pascal, or C. However, 
modern computer software has greatly simplified the creation of simulation 
models. With graphical user interfaces and easy drawing-based model creation, 
it is now almost as easy to create a simulation as it is to draw a flow chart (see 


Figure 19.12). 


Process Step Performance Information 


Cel 02: Exponential Dirtribution 


Open order 
Assumption Name:[Open Prdecr Time (Hours) 
(rom 


Probability 


oo o10 ow 02 o™% 
> 0.04 4 |tintinity 


Rate [1205 
“on | sanet| [ner] cater] conta et | 


Cel C2: Gomme Distribution 


Enter order into system 
Assumption Name: [enter Order 


[rem } 


Probability 


be) 


1s 


O17 207 7.79 
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Loe. 0.17 Scale [1.00 Shape |? 
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Figure 19.10. Order fulfillment process. 


Continued on next page... 
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Process Step Performance Information 
Pick order Celi DZ Normal Distribution 
Assumption Name: [Pick Order =I 
= 
i 
28 340 400 40 520 
> infinity 4 |tinfinity 


Mean [4.01 SuDev[0.4000— 
_ox | Lancet | [Enter } Gallery | Correiate... | Help | 


Stage order Celi C2 Uniform Distribution 
Assumption Name: [stage Order al 
Z 
i 
270 28 3100 315 41% 
Min [2.70] Max[3.30 


9K | Cancet| [Enter] Gallery| Correlate...| Help | 


Package order 


> [2.00 <[40000 
Min[2.00° = Likeliest[3.50 = Max[4.00 


_9K | Sancet| [Emer] Gattery | Corretate...| _Help | 


Figure 19.10 (continued) 
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Process Step 


Performance Information 


Ship order 


Cel G2 Extreme Value Distribution | 
Assumption Name: [Ship Order —s 
| 
2 
3 
= 
< 
ow 200 40 &@ 8.00 
> | Infinity 4 |tIntinity 
Mode |2.0' Seale ||.00 End: © Min © Max 
OK | Cancel | Gallery | _Comretate...| Help | 
Figure 19.10 (continued) 
Forecast: Total Cycle Time 
10,000 Trials Frequency Chart 0 Outliers 
092; - 917 
.069} - 687.7 
Zz = 
— a] 
x «046! - 458.5. 
a] i 
oo | ; oD 
o = 
a 023 229.24 
.000 = 0 
13 18 23 28 
Certainty is 99.90% from -Infinity to 24 Hours 


Figure 19.11. Cycle time for 10,000 orders. 
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Sales Department 8am—5pm Production Department 1pm—5pm 


Avg Wait: 2h 20.1m 
rp _~—Os Get parts 


Total Blocks: 4 


Receive call Pack parts 


Total Cost: $34.83 
Sales rep. QA check 


no 
Calendar: PickUP 
no sale 
No order Shipping 
Remaining: 1 


Figure 19.12. Simulation software interface. 


While the user interface may look like an ordinary flow chart, it is much more 
powertul. A closer look at Figure 19.12 reveals that additional information is 
recorded on the chart. Next to box #2: Receive Call, we see In: 60. This means 
that the simulation program looked at 60 simulated phone calls. By following 
the arrows we can learn that 20 of these calls were sales calls and that this kept 
the simulated sales representatives active for 2 hours and 2 minutes. Other data 
are available from the diagram, including the fact that QA checking cost $34.83 
and that one order remained to be shipped at the conclusion of the simulation. 
If the model is based on an existing system, these numbers will be compared to 
actual process numbers to validate the model. The first simulation should always 
model the past, how else can we trust the model’s forecasts for the future? 

The current system model is interesting and often educational. Many times 
managers and process operators will be surprised to see the model of the system. 
It is common to find that people focus on their particular task without ever 
really understanding their role in the larger scheme of things. The numbers are 
often a greater surprise. Good, clean data must be collected before the simula- 
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tion model can be built and tested. The process of getting these data often 
reveals shortcomings with the existing management information systems. 
Once the confusion is cleared up and management gets their first good look at 
the process, they are often shocked at what they see. On more than one occa- 
sion, the author’s clientele have asked him to place the project on hold until 
the obvious problems can be fixed. 

As intriguing as models of existing systems can be, the real power and excite- 
ment begins when simulation models are applied to process changes. Refer to 
the simple model shown in Figure 19.12 above. There are many questions 
which might arise regarding this process, e.g., 

¢ Our new promotion is expected to double the number of orders phoned 

in, what effect will that have on production? 

e If the QA check was performed by production personnel, what effect 

would that have on QA cost? Total cost? Production throughput? 

In general, the model lets us determine what happens to Y; if we change X. 
Changes often create unanticipated consequences throughout a complex system 
due to their effects on interrelated processes. For example, changing the volume 
of calls might cause an increase in the idle time of the QA checker because it 
increases the delay time in the “Get Parts” bottleneck process. Once this fact 
has been revealed by the simulation, the manager can deal with it. 
Furthermore, the manager’s proposed solution can also be tested by simulation 
before it’s tried in the real world. For example, the manager might propose to 
cross-train the QA person to be able to help Get Parts. This would theoretically 
reduce the wait at the Get Parts step while simultaneously increasing the utiliza- 
tion of the QA person. The simulation would allow this hypothesis to be tested 
before it’s tried. Perhaps it will show that the result is merely to move the bottle- 
neck from one process step to another, rather than eliminating it. Anyone who 
has spent any length of time in the working world is familiar with these “hydrau- 
lic models” where managers’ attempts to fix one problem only result in the crea- 
tion of new problems. By discovering this before trying it, money is saved and 
morale improved. 


EXAMPLE: A SIMULATION OF RECEIVING 
INSPECTION* 


This example describes a simulation model of a complex inspection opera- 
tion at a factory of a large unionized defense contractor. The plant receives 
four types of parts: electrical, simple mechanical, complex mechanical, and 


*“Pyzdek, 1992b. 
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parts or materials that require non-destructive testing (NDT). Union regula- 
tions required four different inspector grades. The plant is experiencing a grow- 
ing backlog of orders awaiting inspection. The backlog is having an adverse 
effect on production scheduling, including frequent missile assembly stoppages. 
A computer simulation will be conducted to answer the following questions: 

1. Is the backlog a chance event that will eventually correct itself without 

intervention, or is a permanent change of process required? 

2. If additional personnel are hired, will they be adequately utilized? 
Which types of job skills are required? 
4, Will additional automated or semi-automated inspection equipment 

alleviate the problem? 


» 


MODEL DEVELOPMENT 


The first phase of the project is to develop an accurate model of the Receiving 
Inspection process. One element to evaluate is the distribution of arrivals of the 
various parts. Figure 19.13 compares the empirical distribution of the electrical 
lots with the predictions of an exponential arrival time model (see Monte Carlo 
simulation in Chapter 16). Data were gathered from a recent work- month. 
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Figure 19.13. Electrical order arrivals predicted vs. actual. 
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Similar “eyeball fits” were obtained from the arrival distributions of the 
other three part types. The exponential model seems to provide adequate rep- 
resentation of the data in each case (i.e. when we use the model parameters to 
simulate past performance, the results of the simulation are quite close to what 
actually happened). The parameter estimates (average arrival rates) used for 
the models are shown in Table 19.4. 


Table 19.4. Average arrival rates. 


MEAN ARRIVAL RATE 

ORDER TYPE (ORDERS-PER-HOUR) 
Electrical 4.292 
Simple mechanical 6.849 
Complex mechanical 1.541 
Non-destructive test 0.630 


Another aspect of the model development is to describe the distribution of 
inspection time per order. Recent time studies conducted in Receiving 
Inspection provide data of actual inspection times for the four different parts. 
The exponential model proved to be adequate, passing a chi-square goodness- 
of-fit test as well as our “simulation of the past” check. The parameter estimates 
for the inspection times are given in Table 19.5. 


Table 19.5. Average inspection times. 


AVERAGE INSPECTION TIME 
ORDER TYPE (ORDERS-PER-HOUR) 
Electrical 1.681 
Simple mechanical 2.500 
Complex mechanical 0.597 
Non-destructive test 0.570 


Figure 19.14 shows the exponential curve, based on 228 orders, fitted to 
inspection times for electrical orders. Several studies showed that, on average, 
it takes four times longer to check a complex mechanical order using a manual 
surface plate layout than it takes on a coordinate measuring machine (CMM). 
(These interesting discoveries often result from simulation projects.) 
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Figure 19.14 Electrical order inspection times. 


Time studies indicated that rejected lots required additional time to fill out 
reject tags and complete the return authorization paperwork. The distribution 
of this process time is uniform on the interval [0.1 h, 0.5 h]. The proportion of 
lots rejected, by order type, was evaluated using conventional statistical process 
control techniques. The charts indicated that, with few exceptions, the propor- 
tion of lots rejected is in statistical control and the binomial distribution can 
be used as the model. The resulting estimated reject rates are given in Table 
19.6. The evaluated lots were produced over a relatively short period, so the 
data in Table 19.6 should be regarded as tentative. 


Table 19.6. Average reject rates. 


ORDER TYPE % LOTS REJECTED #t LOTS EVALUATED 
Electrical 2.2 762 
Simple mechanical 1.1 936 
Complex mechanical 25.0 188 
Non-destructive test 0.5 410 
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MANAGEMENT CONSTRAINTS 


A very important input in the model development process is a statement of 
constraints by management. With this project, the constraints involve a descrip- 
tion of permissible job assignments for each inspector classification, the over- 
time policy, the queue discipline and the priority discipline for assigning jobs 
to inspectors as well as to the CMMs. Table 19.7 summarizes the permissible 
job assignments. A “0” indicates that the assignment is not permitted, while a 
“1” indicates a permissible assignment. 


Table 19.7. Permissible inspector assignments. 


ORDER TYPE 
INSPECTOR Simple Complex 
TYPE Electrical mechanical mechanical NDT 
Electrical 1 0 0 0 
Grade 11 0 1 0 0 
Grade 19 0 1 1 ) 
NDT ) ) ) 1 


The simulation will be run under the assumption that overtime is not per- 
mitted; 40 hours is considered a complete work week. Preference is given to 
the lower paid Grade 11 inspectors when a simple mechanical order is assigned. 
The CMM is to be used for complex mechanical parts when it is available. 
Inspection is conducted using a first-in first-out (FIFO) protocol. 


BACKLOG 


The backlog is a composite of all part types. Information on when the par- 
ticular order entered the backlog is not available. At the time the simulation 
was proposed, the backlog stood at 662 orders with the composition shown in 
Table 19.8. 

By the time the computer program was completed four weeks later, the back- 
log had dwindled to 200 orders. The assumption was made that the percentage 
of each order type remained constant and the simulation was run with a 200 


order backlog. 
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Table 19.8. Backlog composition. 


ORDER TYPE BACKLOG PERCENT 


Electrical 


Simple mechanical 


Complex mechanical 


NDT 


THE SIMULATION 


The first simulation mimics the current system so the decision maker can 
determine if the backlog is just a chance event that will work itself out. The 
simulation begins with the current staff, facilities, and backlog and runs 4 sim- 
ulated regular weeks of 40 hours per week. This is done 6 times and the following 
statistics computed: 

1. Average delay awaiting inspection. 


2. Maximum delay awaiting inspection. 
3. Average backlog. 

4. Maximum backlog. 

5. 


Utilization of the inspectors. 

6. Utilization of the CMM. 

Statistics 1 through 4 will be computed for each part type; statistic 5 will be 
computed for each inspector type. 


Modified systems 

Simulations provide an ideal way of evaluating the impact of proposed man- 
agement changes. Such changes might include inspection labor and the number 
of CMMs; therefore, these were programmed as input variables. In discussions 
with management, the following heuristic rules were established: 


If U, < (n, — 1)/n;, i = 1, 2, 3, 4, then letn, = n, — 1, 
Where U; = Utilization of inspector type i 
n, = Number of inspectors of type i. 


For example, suppose there are three electrical inspectors (ie., n; = 3), 
and the utilization of electrical inspectors is 40% (U; = 0.4). The heuristic 
rule would recommend eliminating an electrical inspector since 0.4 < 
(3 — 1)/3 = 0.67. 
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A decision was made that the reductions would take place only if the backlog 
was under control for a given order type. The author interpreted this to mean 
that a two sigma interval about the average change in backlog should either con- 
tain zero backlog growth, or be entirely negative. 


Results of simulations 

The first simulation was based on the existing system, coded 5—2—5—2-1, 
meaning 

¢ 5 electrical inspectors 

¢ 2grade 11 inspectors 

¢ 5 grade 19 inspectors 

e¢ 2 NDT inspectors 

¢ 1CMM 

The results of this simulation are shown in Table 19.9. 

After 6 simulated weeks: 


JOB AVERAGE AVERAGE CHANGE STD. DEV. OF 

TYPE UTILIZATION IN BACKLOG CHANGE IN BACKLOG 
Electrical 0.598 —96.333 6.3140 
Mech-simple 0.726 —64.000 8.4617 


Mech-Complex 


0.575 —14.500 3.5637 


NDT 


0.640 —22.500 3.7283 


The heuristic rule describes the direction to go with staffing, but not how far. 
Based solely on the author’s intuition, the following configuration was selected 
for the next simulation: 

¢ 3 electrical inspectors 

¢ 2grade 11 inspectors 

¢ 3 grade 19 inspectors 

e¢ 2 NDT inspectors 

¢ 1CMM 

The results of simulating this 3-2-3-2-1 system are given in Table 19.10. 
All average utilization values pass the heuristic rule and the backlog growth 
is still, on the average, comfortably negative. However, the electrical order 
backlog reduction is considerably more erratic when the inspection staff is 
reduced. 
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Table 19.9. Current system 5—2—5—2-1 simulation results. 


Type Inspector Packie oi 

Inspection Inspectors Utilization Avg. | Max. | Number | Utilization 
Run 1 
Flectria : a 
Mech-simple 2 0.704 
Mech-Complex 5 0.545 0.7 16 0.526 
NDT 2 0.622 4.3 25 
Run 2 
Electrical 5 0.623 97 
Mech-simple 2 0.752 68 
Mech-Complex 5 0.621 11 1 0.501 
NDT 2 0.685 24 
Run 3 
Electrical 5 0.613 8.3 107 
Mech-simple 2 0.732 Sa ae a 
Mech-Complex 5 0.596 30 1 0.495 
Run 4 
Electrical 5 0.608 93 
Mech-simple 2 0.726 67 
Mech-Complex 5 0.551 14 1 0.413 
NDT 2 0.665 28 
Run oe es ee ee 
Electrical 5 0.567 ee 
Mech-simple 2 0.684 | 29 | wf] f 
ieee a ee a a ce 
Run 6 
Electrical 5 0.598 6.6 96 
Mech-simple 2 0.755 2.4 65 
Mech-Complex 5 0.584 1.6 19 1 0.493 
NDT 2 0.735 5.0 22 
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Table 19.10. 3—2—3—2-1 system simulation results. 


Backlog CMM 
Type Inspector 
Inspection Inspectors Utilization Avg. | Max. | Number | Utilization 
Run 1 
Electrical 


Mech-simple 


Mech-Complex 0.595 
NDT ; 

Heil 
Mech-simple 2 0.866 8.2 70 

Mech-Complex 3 0.863 2.5 16 1 0.629 
NDT 2 0.631 3.5 22 

Run 3 

Electrical 

Mech-simple 

Mech-Complex 0.623 
NDT 

Run 4 

Electrical 3 0.879 31.2 109 

Mech-simple 2 0.927 7.2 52 

Mech-Complex 3 0.924 5.6 26 1 0.632 
NDT 2 0.715 3.8 25 

Run5 

Electrical 

Mech-simple 

Mech-Complex 0.537 
NDT 

Run 6 

Electrical 3 0.990 39.9 95 

Mech-simple 2 0.844 6.9 63 

Mech Compl sae 
NDT 2 0.716 4.2 24 
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After 6 simulations: 


JOB AVERAGE AVERAGE CHANGE STD. DEV. OF 
TYPE UTILIZATION IN BACKLOG CHANGE IN BACKLOG 
Electrical 0.965 —91.833 20.5856 
Mech-simple 0.861 —54.667 8.7331 
Mech-Complex 0.842 —15.833 1.3292 
NDT 0.676 —23.500 1.3784 


While this configuration was acceptable, the author believed that additional 
trials might allow replacement of one or more of the highly paid grade 19 inspec- 
tors with the lower paid grade 11 inspectors. A number of combinations were 
tried, resulting in the 3-3—1—2—1 system shown in Table 19.11. 

After 6 simulations: 


JOB AVERAGE AVERAGE CHANGE STD. DEV. OF 
TYPE UTILIZATION IN BACKLOG CHANGE IN BACKLOG 
Electrical 0.965 —93.667 6.9762 
Mech-simple 0.908 —57.500 5.8224 
Mech-Complex 0.963 —5.500 18.1411 
NDT 0.704 —25.500 2.7386 


The 3—3—1—2-1 system complies with all management constraints relating to 
resource utilization and backlog control. It is recommended to management 
with the caution that they carefully monitor the backlog of complex mechanical 
orders. For this type of order, the simulation indicates negative backlog growth 
on average, but with periods of positive backlog growth being possible. 


Conclusion 

The simulation allowed the receiving inspection process to be “changed” 
without actually disrupting operations. In the computer, inspectors can be 
added, removed, or reassigned without the tremendous impact on morale and 
operations that would result from making these changes in the real world. It is 
a simple matter to add additional CMMs which would cost six figures in the 
real world. It is just as easy to try different job assignment protocols, examine 
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Table 19.11. 3-3—1—2-1 system simulation results. 


Type Inspector Bacecs uM 
Inspection Inspectors Utilization Avg. | Max. | Number | Utilization 

Run 1 

Electrical 3 0.937 37.0 110 

Mech-simple 3 0.885 13.1 61 

Mech-Complex 1 0.967 74 21 1 0.718 
NDT 2 0.604 3.4 25 

Run 2 

Electrical 3 0.932 26.8 100 

Mech-simple 3 0.888 7.9 58 

Mech-Complex 1 0.925 17.8 49 1 0.722 
NDT 2 0.607 4.0 27 

Run 3 

Electrical 3 0.997 74.1 119 

Mech-simple 3 0.915 14.6 58 

Mech-Complex 1 0.957 20.6 40 1 0.807 
NDT 2 0.762 7.1 22 

Run 4 

Electrical 3 0.995 42.2 96 

Mech-simple 3 0.976 38.4 79 

Mech-Complex 1 0.997 23.8 56 1 0.865 
NDT 2 0.758 4.8 30 

Run5 

Electrical 3 0.996 61.3 121 

Mech-simple 3 0.913 7.7 50 

Mech-Complex 1 0.996 21.7 52 1 0.909 
NDT 2 0.820 74 30 

Run6 

Electrical 3 0.933 35.3 101 

Mech-simple 3 0.867 5.7 59 

Mech-Complex 1 0.938 17.8 49 1 0.736 
NDT 2 0.674 8.8 33 
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the impact of a proposed new product line, look at new work area layouts, see if 
we can solve a temporary problem by working overtime or hiring temporary 
workers, etc. The effect of these changes can be evaluated in a few days, rather 
than waiting several months to learn that the problem was not resolved. 


Virtual DOE using simulation software 


Modern simulation software can interface with statistical analysis software 
to allow more detailed analysis of proposed new products and processes. In 
this section P’ll demonstrate this capability with iGrafx Process for Six Sigma 
and Minitab. However, these capabilities are also incorporated into other soft- 
ware packages. 


EXAMPLE 


A Six Sigma team has developed the process shown in Figure 19.15. The 
CTQs for the process are the cycle times required for processing transactions 
for new and existing customers. They want to recommend staff levels that pro- 
duce good CTQ results for both customer types during both normal and busy 
workload times. They will determine the recommended staff levels by perform- 
ing simulations and analyzing the results using DOE techniques. 


Packages | Order 


Figure 19.15. Process to be evaluated using virtual DOE. 
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Figure 19.16 shows the dialog box for the iGrafx “RapiDOE” procedure. The 
top part of the box displays the available factors. The team wants to evaluate 
their two CTQs as the interarrival rate varies, and for different staff levels for 
six different types of workers. The middle of the box indicates that the experi- 
ment will be replicated four times. The bottom of the dialog box shows the 
CTQs the Black Belt has selected for evaluation. 

Figure 19.17 shows the RapiDOE Minitab options dialog box. The Black Belt 
will use a fractional factorial design with 64 runs. Minitab’s display of 
Available Factorial Designs (Figure 19.18) indicates that this half-fraction 
seven-factor, 64 run design is resolution VII. This will allow the estimation of 
all main effects, two-factor interactions, and three-factor interactions. 

In just a few minutes the 256 simulated experimental runs are completed 
(Figure 19.20). The analysis of these results proceeds in exactly the same way as 
it would with the results from real-world experiments. Of course, the conclu- 
sions are not as trustworthy as real-world experimentation would provide. 
However, they are certainly a lot cheaper and faster to obtain and they provide 


a a 


Rospante Replicatons: fc 


Figure 19.16. iGrafx Process for Six Sigma RapiDOE display. 
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Figure 19.17. iGrafx Process for Six Sigma RapiDOE Minitab options. 


a great deal of insight into the process bottlenecks, areas of potential improve- 
ment and other important factors. Virtual DOE also allows trial-and-error with- 


out disrupting operations or impacting customers. 


Create Factorial Design - Display Available Designs 


Ivi Ivi Iv 


Available Resolution Ill Plackett-Burman 
Factors Runs Factors Runs Factors Runs 
2-7 = 8, 12.16,20,...48 20-230 24,28,32,36,....48 36-39 40,44,48 
8-11 12.16,20,24,....48 24-27 =. 28.32,36,40,44,48 40-43 44, 4B 
12-15 16.20,24,28.....48 28-31 32.36.40,44,48 44-47 = 48 
16-19 20,24,26,32,...48 32-35 36,40,44,48 


Ewes} = 


Figure 19.18. Minitab display of available Factorial Designs. 
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Figure 19.20. Partial display of results from virtual DOE. 
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Design phase cross-references 


In addition to simulation and process mapping, many of the tools used in 
DMAIC projects can also be applied in the design phase of DMADV (Table 


19.12). 


Table 19.12. Six Sigma tools commonly used in the design phase of DMADV. 


CONCEPT 


CROSS-REFERENCE 


Taguchi robust design concepts 


Chapter 17 


Risk assessment 


Process capability analysis 


Chapter 16 


Chapter 13 


Design of experiments 


Chapter 17 


Lean 


VERIFY 


The tasks and responsibilities for the Verify phase of DFSS projects are 


shown in Figure 19.21. 


Chapter 20 


Resource Names 


ID | Task Name 

37 |Verify 

$8 Develop control plan 

38 Implement FMEA recommendations 

o Standardize wherever possible 

a Establish contro! metrics 

i Develop metrics collection tool 
Transition Plan 

4 Train and hand off to process operators 
eS Monitor process using Control Plan 

Bi "Tweak" design as required 

At Sponsor project review 

48 Accept deliverables 

“8 Identify lessons learned and best practices 
ot Plan for learning transfer to other areas 


Process Owner 
Process Owner 
Process Owner 
Black Belt 


Process Expert,Process Operator 
Process Owner,Black Belt 
Process Owner,Process Expert 


Sponsor 
Sponsor,Black Belt 
Sponsor,Business Leader 


Figure 19.21. DFSS verify tasks and responsibilities. 
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Pilot run 


Although the design was thoroughly evaluated, there is no substitute for 
doing. The team should assure that their operating procedures, operator train- 
ing, materials, information systems, etc. actually produce the predicted results. 
The pilot run consists of a small-scale, limited time run of the new design 
under the careful watch of the process expert. Metrics are collected and ana- 
lyzed to determine if the CTQ predictions are reasonably accurate under condi- 
tions a bit closer to the real world than a computer simulation. Actual 
customers are served by the new design and their reactions are closely moni- 
tored. Of course, the results of the pilot are analyzed bearing in mind that profi- 
ciency will improve with practice. Still, unanticipated problems are nearly 
always discovered during pilot runs and they should not be overlooked. 


Transition to full-scale operations 


Full-scale operations is to the pilot run as the pilot run is toa simulation. The 
hand-off should be gradual, with redesign options open until enough time has 
passed to assure that the new design is stable. Process owners are the primary 
decision maker when it comes to declaring the hand-off complete. The transi- 
tion should be planned as a subproject, with tasks, due dates, and responsibility 
assigned. 


Verify phase cross-references 


The verify phase of DMADV projects is very similar to the control phase of 
DMAIC projects. Review the materials cross-referenced in Table 19.13 for 
details. 


Table 19.13. Six Sigma tools commonly used in the verify phase of DMADV. 


CONCEPT CROSS-REFERENCE 


FMEA Chapter 16 


DMAIC control planning Chapter 18 
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Lean Manufacturing and 
Six Sigma 


INTRODUCTION TO LEAN AND MUDA 


Lean Production’s origins date back to the post-World War I era in Japan. It 
was developed by Taiichi Ohno, a Toyota production executive, in response to 
a number of problems that plagued Japanese industry. The main problem was 
that of high-variety production required to serve the domestic Japanese market. 
Mass production techniques, which were developed by Henry Ford to econom- 
ically produce long runs of identical product, were ill-suited to the situation 
faced by Toyota. Today the conditions faced by Toyota in the late 1940s are 
common throughout industry and Lean is being adopted by businesses all over 
the world as a way to improve efficiency and to serve customers better. 

The Lean approach (the term Lean was coined in the early 1990s by MIT 
researchers) systematically minimizes waste—called muda—in the value 
stream. Muda includes all types of defective work, not just defective products. 
Wasted time, motion, and materials are all muda. Ohno (1988) identified the 
following types of muda in business: 

1. Defects 
Overproduction 
Inventories (in process or finished goods) 

Unnecessary processing 
Unnecessary movement of people 
Unnecessary transport of goods 
Waiting 


NAMB YD 
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Womack and Jones (1996) added another type of muda: 
8. Designing goods and services that don’t meet customers’ needs 


To “think Lean” is to declare war on muda. It is to focus on muda’s oppo- 
site: value. Defining value means answering the questions: 


What are customers willing to pay for? 
By what processes are these values created? 
How does each activity in the process help meet the wants and needs of the 
customer? 
How can we make the value creation processes flow more efficiently? 
How can we be sure that we’re producing only what is needed, when it’s 
needed? 
How can we become perfect at creating value? 

The Lean answers to these questions can be grouped into five categories: 
value, the value stream, flow, pull, and perfection. We will look at each of these 
areas in greater detail. 


WHAT IS VALUE TO THE CUSTOMER? 


Value is what customers want or need, and are willing and able to pay for. 
This isn’t always easy to determine, especially for new products or services, 
but it must be done. For existing products use focus groups, surveys, and other 
methods described in Chapter 3. For new products, consider the DFSS methods 
described in Chapter 19. Most importantly, DO NOT RELY ON 
INTERNAL SOURCES! Most companies start with what they already know 
and go from there, tweaking their existing offering in some way. Customer 
input involves asking customers what they like or don’t like about the existing 
offering, or what they'd like to see added or changed. The result is incremental 
change that may or may not address what the customers are really after. The 
definition of value must begin with the producer and customer jointly analyzing 
value and challenging old beliefs. 


Example: Weld dents 

A team had the task of reducing defects on shelves used in supermarkets. The 
number one problem was “weld dents,” a condition caused when brackets 
were welded to the shelves. A great deal of effort went into inspecting shelves 
for this condition, running laboratory tests to determine the impact of weld 
dents on the durability of the shelves, reworking shelves that had weld dents, 
etc. Scrap costs were very high. When the team met with customers to try to 
operationally define unacceptable weld dents they made an amazing discovery: 
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customers didn’t know what weld dents were! Even more strange, when shown 
shelves with no weld dents and those with “extreme” weld dents, customers 
couldn’t care less. However, customers did care about the shape of the front of 
the shelves. They wanted nice, straight looking shelf fronts that looked stream- 
lined when lined up in long supermarket aisles. They were not happy at all 
with what was being delivered. No one inside the company knew that this was 
important to customers, and no efforts were underway to improve this aspect 
of the product. 


The value definition 


If the supermarket manager was asked to define value, chances are he 
wouldn’t say “Shelves that have straight fronts that line up.” Instead he might 
say “Shelves that look good to my customers when they look down the aisle.” 
The importance of obtaining the voice of the customer, and using this voice to 
drive business processes, was discussed in Chapter 3. Those vital Six Sigma 
lessons need to be integrated into Lean as well. 

With your definition of value in hand, you can now begin to evaluate which 
activities add value and which activities are muda. The results are often surpris- 
ing. In some cases most activities are not value added. For example, one Six 
Sigma team working on improving purchase order (PO) cycle time (defined as 
the time from receiving a request for a PO to the time the requestor received 
the PO) conducted a little test. They made a list of all the people whose signature 
was needed for PO approval. Then the team members (with the approval of 
the Director of Purchasing) hand-carried ten POs through the process. Each 
Purchasing Agent was to treat the team member’s request as their number 1 
priority, dropping every other activity until it was completed. The team discov- 
ered that it took an average of about six hours to process a PO. The average pro- 
cessing time in the real world was six weeks. Assuming a 40-hour work-week, 
the value-added time accounted for only 2.5% of the total time a PO was in the 
system. The remaining 97.5% was muda. 

Even that’s not the full extent of the muda. During the walk-throughs the 
team also began to question why some of the approvals were needed. In some 
cases, such as POs for standard hardware or basic supplies, the requestor could 
be empowered to place the order. Many POs could be eliminated completely 
with automatic pull ordering systems (see below for more on pull systems). 
The value-added portion of the purchase order approval process was tiny 
indeed. 

The immediate impact of such discoveries is fear. Imagine yourself as the 
Director of Purchasing or a Purchasing Agent. Along comes a team with data 
that indicate that most of your department is non-value added. Is it any wonder 
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that change agents so often talk about “resistance to change”? Who wouldn’t 
resist change when that change is you losing your job? Yet this is often the case 
and the leadership needs to face up to this reality and to plan for it. They have 
a responsibility to the shareholders that dictates that they reduce muda. They 
have a responsibility to customers to produce value. But they also have a respon- 
sibility to the employees to treat them fairly. Unless all the leadership makes it 
clear that fair treatment is guaranteed, you can expect strong resistance from 
people threatened by the change. 

The purchasing department needs to rethink the value they add, i-e., their 
mission. If their job isn’t bureaucratic paper-shuffling, then what is it? Perhaps 
it is better defined as improving the integration of the supply chain with the 
rest of the value stream (see below for a discussion of the value stream). This 
might involve looking at how suppliers can help design easier-to-produce 
parts, how they can deliver to precisely the right place and at precisely the 
right time, what they can do to help your customers succeed, etc. This is easier 
to do in the Process Enterprise, where core business processes control the defi- 
nition of work (see Chapter 3). In the end the transformed “purchasing depart- 
ment” will probably look much different than it did at the beginning. But if 
people feel that management treated everyone fairly chances are morale will 
improve even while muda is eliminated. After all, who wants to be muda? 

The good news is that when Lean organizations redefine value, they often 
find that they have discovered the key to finding more customers (and more 
sales) very quickly. The increased demand often outpaces the rate at which 
resources are converted from muda to value creation. Although this isn’t guar- 
anteed, it happens often enough to provide a measure of comfort to employees, 
especially if they see it happening in their own organization. They may still 
need to acquire new skills to do a different kind of work, but they are usually 
able to adapt to this. 


Kinds of waste 
When trying to identify muda it may be helpful to think of certain categories 
of waste. One handy mnemonic is CLOSEDMITTS (Spencer, 1999) (Table 
20.1). 


WHAT IS THE VALUE STREAM? 


A value stream is all activities, both value added and non-value added, 
required to bring a product from raw material into the hands of the customer, 
a customer requirement from order to delivery, and a design from concept to 
launch. Value stream improvement usually begins at the door-to-door level 
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Table 20.1. CLOSEDMITTS. 


Type of Waste Example 

Complexity Unnecessary steps, excessive documentation, too many permissions 
needed. 

Labor Inefficient operations, excess headcount. 

Overproduction Producing more than the customer demands. Producing before the 
customer needs it. 

Space Storage for inventory, parts awaiting disposition, parts awaiting 
rework and scrap storage. Excessively wide aisles. Other wasted 
space. 

Energy Wasted power or human energy. 

Defects Repair, rework, repeated service, multiple calls to resolve problems. 

Materials Scrap, ordering more than is needed. 

Idle materials Material that just sits, inventory. 

Time Waste of time. 

Transportation Movement that adds no value. 

Safety hazards Unsafe or accident-prone environments. 


within a facility, and then expands outward to eventually encompass the full 
value stream (Womack and Jones, 1996, page 311). A value stream consists of 
both product and service flows and information flows. 

Waste is any activity that consumes resources but creates no value for the cus- 
tomer, thus waste activities are called “non-value added.” Table 20.2 lists the 
activities involved in commuting to work via bus. Of the 49 minutes consumed 
by the trip, only 19 involve movement of the passenger towards his destination. 
This means that 39% of the time is value added, which isn’t too bad for a typical, 
pre-Lean process. Although it is generally not possible to achieve 100% value- 
added processes, it is nearly always possible to make significant improvement 
to processes by applying Lean methodologies. 
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Table 20.2. Bus ride value added and non-value added time. 


ACTIVITY TIME (MINUTES) TYPE 


Drive to park-and-ride 


Value added 


Park the car 1 Non-value added 
Wait for bus 3 Non-value added 
8 
7 
11 


Bus moving away from destination Non-value added 
Stops for passenger loading or unloading Non-value added 
Waiting in traffic Non-value added 
Moving towards destination 12 Value added 
TOTAL TIME 49 
VALUE ADDED TIME 19 


Value stream mapping 


One useful Lean tool is value stream mapping. Value stream mapping, also 
known as material and information flow mapping, is a variation of process map- 
ping that looks at how value flows into and through a process and to the custo- 
mer, and how information flows facilitate the work flow. One way to view a 
process is the logical flow of work. Another view is the physical flow of work. 
Figure 20.1 shows the logical flow of work for a technical support process. The 
Black Belt determined that the value-added steps were the ones shown with a 
drop-shadow box. The process map makes it obvious that the bulk of the work 
in the process is not part of the value stream, it’s muda. However, that doesn’t 
mean that all of the non-value added steps can be eliminated. A few of the steps 
involve recording information that can be used in the future to make it faster 
and easier to find the right answers. What may be muda to the present customer 
may actually be value-added work to a future customer. Such judgement calls 
are common in Lean. 
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Figure 20.1. Flow of work through email technical support. 


The role of value stream mapping in the overall context of Lean is: 
Define value from the customer’s view 

Map the current state of the value stream 

Apply the tools of Lean to identify muda in the current value stream 
Map the future state process 

Develop a transition plan 

Implement the plan 

Validate the new process 
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HOW DO WE MAKE VALUE FLOW? 


The key to value flow is the customer’s requirements. What the customer 
needs and when he needs it drives all activity. This concept is often called Takt 
time. The formula for Takt time is shown in Equation (20.1). 


. Available work time 
Takt time = - (20.1) 
ustomer required volume 
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Work time does not include lunches, breaks, or other process downtime. 
Generally, Takt time is used to create short-term (daily, weekly) work sche- 
dules. 


Example of Takt time calculation 


A satellite manufacturer receives orders for 26 satellites per year. 


; 26 satellites ; 
Takt time = = 1 satellite every 10 days (20.2) 
260 work days/year 


This means that every workcell and operation has to move one system’s 
worth of work through every ten work days, no less and no more. For 
example, if an average satellite requires 10 batteries, then the battery operation 
needs to produce one battery per work day, if a satellite needs 1,000 circuit 
boards, then 100 boards need to be completed every work day. 

If the historical process average is 20 satellites per year, then the time to pro- 
duce a satellite is 13 work days, substantially short of the 10 day Takt time. In 
this case efforts need to focus on improving cycle time. On the other hand, if 
the historical average is 30 satellites per year, then production time is only 8.67 
days per satellite and focus should be on increasing sales and reducing resources 
to the level dictated by customer demand. 


Spaghetti charts 

Current state physical work flow is often depicted on spaghetti charts. A spa- 
ghetti chart is a map of the path taken by a specific product as it travels down 
the value stream in a mass-production organization, so-called because the pro- 
duct’s route typically looks like a plate of spaghetti. To create a spaghetti chart, 
like the one shown on the left in Figure 20.2, tell a person to “be the part” and 
to physically walk through the process as the part would go through it. 
Sometimes a part travels miles in the original process configuration, and only a 
few feet in the Lean layout. The Lean layout is shown on the right in Figure 
20.2. The difference between the current state layout and the Lean layout is 
muda. 

When setting goals for a future state process, it is often helpful to stretch the 
mind. One way to become inspired is to identify the absolute best in class per- 
formance for a particular activity. For example, the quick lube joints’ claim to 
exceptional value is that they can get you in and out in 15 minutes or less, 
much quicker than the corner “service station” which often took a couple of 
hours or more. But consider the pit crew of a Nascar racing team, which can per- 
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Figure 20.2. Spaghetti chart versus Lean flow. 


form maintenance on a car so fast (14 seconds or less) they make your local 
Quickie Lube look like they’re working at a crawl. And during that 14 seconds 
they do a great deal more than change the car’s fluids. They gas it up, wash the 
windows, change all of the tires, etc. (Figure 20.3). There are many published 
examples of Lean achievements that can serve to educate and inspire. At the 
CAMI factory operated by GM and Suzuki, machine changeover time was 
reduced from 36 hours to 6 minutes. 


HOW DO WE MAKE VALUE FLOW AT THE PULL OF 
THE CUSTOMER? 


The key to value flow is to break the mental bonds of the batch-and-queue 
mindset. Batch and queue are everywhere. At your favorite restaurant where 
youare handed a little device to alert you when your table is ready. At the airport 
where you move from one line to another to another and show the same ID sev- 
eral times. At your physician’s office where it’s made clear to you that your 
time is less important than the doctor’s time. On the phone where you find 
yourself on hold. On the waiting list for a surgical procedure. At home all day 
waiting for a cable installer who, we're told, will be there “sometime 
Wednesday.” 
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Figure 20.3. UPS racing team pit crew. 


Batch and queue are also endemic to our businesses. It’s hard to imagine that 
at one point it was a fantastic innovation! Mass production is based on produc- 
ing large lots of identical items to meet anticipated demand. This makes great 
efficiencies possible because the costs of setups, tooling, etc. are amortized 
over a very large number of units, making the per-unit costs very low. It also 
means inventory (queues for parts and materials), and longer cycle times due 
to the waiting. Choices are limited to those favored by the many. The term “cus- 
tomized,” derived from the same root as customer, has no meaning. 
Production is to schedule, not to demand. 

Flow focuses on the object of value. The product, design, service, order, etc. 
that is being created for the customer. The focus is mot on the department, the 
supplier, the factory, the procedure, the tooling, the setup, the inventory or 
any other facet of the enterprise or its operation. All work practices are carefully 
evaluated and rethought to eliminate stoppages of any kind so the object of 
value proceeds smoothly and continuously to the customer. 


Tools to help improve flow 


Flow requires that the whole process be considered simultaneously. 
Generally the process begins with the order and ends with the customer receiv- 
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ing what was ordered. It requires, in effect, a customer-driven organization as 
described in Chapter 3. QFD is a useful tool in assuring that value is properly 
specified, designed, produced, and delivered to the customer. Other tools 
include: 
5S. 5S is the starting point for Lean deployment. 5S stands for Sort, Set in 
order, Shine, Standardize, and Sustain. These terms are defined as follows: 
© Sort. Clearly distinguish what is necessary to do the job from what is 
not. Eliminate the unnecessary. 
© Set in order. Put needed items in their correct place to allow for easy 
accessibility and retrieval. 
© Shine. Keep the workplace clean and clear of clutter. This promotes 
safety as well as efficiency. 
© Standardized cleanup. Develop an approach to maintaining a clean 
and orderly work environment that works. 
© Sustain. Make a habit of maintaining your workplace. 
Constraint management. Constraints, or bottlenecks, require special 
attention. A process constraint is that step or part of the process that limits 
the throughput of the entire process. As such, they determine how much 
output the process can produce. When a constraint isn’t producing, the 
process isn’t producing. Every effort needs to be focused on assuring that: 
© The constraint has sufficient resources to keep running 
© Every unit supplied to the constraint is of acceptable quality 
© Every unit produced by the constraint is of acceptable quality 
© The constraint is operated in as efficient a manner as is possible 
Level loading. Level loading is the process of generating a schedule that is 
level, stable, smooth, and responsive to the market. The goal of level load- 
ing is to make the same quantity of an item every day. It is driven by Takt 
time. A level loaded schedule can be obtained as follows: 
daily work time 
daily quantity needed 
© For each part, list part name, part number, daily quantity needed, 
Takt time 
© Sort the list by quantity needed and Takt time. This is your level 
loaded schedule 
Pull systems. Traditional mass production is a push system. Push systems 
can be summarized as “Make a lot of stuff as cheaply as possible and 
hope people will buy it.” Push systems minimize the number of setups 
and changeovers and use dedicated, specially designed equipment to pro- 
duce identical units. Pull systems can be summarized as “Don’t make any- 
thing until it is needed, then make it fast.” A pull system controls the 
flow and quantity produced by replacing items when they are consumed. 


= Takt time 


© Calculate 
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When I was in high school I worked in a supermarket that used a pull sys- 
tem. I’d walk down the aisles, note what was in short supply, then put 
more on the shelf. The storage area of a modern supermarket is very 
small compared to the retail floor area. In fact, supermarkets were the 
inspiration behind Taiichi Ohno’s creating Lean at Toyota. Pull systems 
require level loading and flexible processes. 

Flexible process. Flexible processes are lightweight and maneuverable 
tools, and fixtures and equipment located and positioned to improve 
safety, ergonomics, quality, and productivity. They are the opposite of 
the big, heavy, permanently positioned counterparts traditionally used 
for mass production. A flexible shop can be quickly reconfigured to pro- 
duce different items to meet changing customer demands. Flexible pro- 
cesses are related to level loading and pull. A completely flexible process 
would allow the factory to be instantly reconfigured to produce an item 
as soon as an order for it arrived. This ideal can’t be met, but it can be 
approximated over some small time interval, such as a day. 

Lot size reduction. Lot size refers to the amount of an item that is ordered 
from the plant or supplier or issued as a standard quantity to the produc- 
tion process. The ideal lot size for flow is one. Larger lot sizes lead to larger 
quality problems due to delayed feedback, excessive inventory, obsolete 
inventory, etc. Of course, there are offsetting benefits such as quantity dis- 
counts, fewer setups, lower transportation costs, etc. In practice the costs 
and benefits must be balanced to achieve an optimum. 

Putting all of these things together, the ideal scenario becomes: a customer 
orders an item or items (pull), the factory has the resources to produce the 
order (level loading), processes are configured to create the items ordered (flex- 
ible process), the order is produced and delivered to the customer exactly 
when he needs it. 


HOW CAN WE CONTINUE TOWARDS PERFECTION? 


Years ago there was a popular concept in the area of quality known as the 
“Acceptable Quality Level,” or AQL. AQL was a term used to define the long- 
term defect rate for a supplier’s process that was acceptable to the customer. 
AQLs were widely used in the military procurement area, and I became heavily 
involved with them when I took a position as Quality Engineer in a missile pro- 
duction facility. I have previously worked for commercial operations where I 
had experience successfully implementing statistical process control methods. 
However, when I tried to introduce the approach in a production area at the 
missile manufacturer I was told it wasn’t necessary because “We already meet 
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the AQL.” I did a bit of research and discovered that the AQL for the process I 
was interested in was 0.2%, which was actually written into the purchase order. 
This was a complex item with many CTQs. When I collected data and calcu- 
lated the process average defect rate I learned that every CTQ was averaging 
0.2%! The AQL had become an anchor on quality improvement. 


KAIZEN* 


KAIZEN is a philosophy of continuous improvement, a belief that all 
aspects of life should be constantly improved. In Japan, where the concept 
originated, KAIZEN applies to all aspects of life, not just the workplace. In 
America the term is usually applied to work processes. The KAIZEN 
approach focuses attention on ongoing improvement that involves everyone. 
Its domain is that of small improvements from ongoing efforts. Over time 
these small improvements can produce changes every bit as dramatic as the 
“big project” approach. KAIZEN does not concern itself with changing fun- 
damental systems. Rather, it works to optimize the existing systems. All 
jobs in any given organization have two components: process improvement 
and process control. Control, as described above, involves taking action on 
deviations to maintain a given process state. In the absence of signals indicat- 
ing that the process has gone astray, control is achieved by adhering to estab- 
lished standard operating procedures (SOPs). In contrast, improvement 
requires experimentally modifying the process to produce better results. 
When an improvement has been identified, the SOPs are changed to reflect 
the new way of doing things. Imai (1986) describes the perception of job 
responsibilities (improvement or maintenance) based on job function 
(Figure 20.4). 

In Figure 20.4 the lower portion involves maintaining the process at its cur- 
rent level by following the SOPs. KAIZEN fits into the upper portion of this 
picture. However, the upper portion goes beyond KAIZEN. Imai illustrates 
the relationship as shown in Figure 20.5. 

Figure 20.5 illustrates that, as mentioned earlier, KAIZEN does not cover 
radical innovations (that’s where Six Sigma comes in). It can be seen that all 
levels of management share responsibility for KAIZEN. Since work is always 
done according to standards, the standards must be viewed as dynamic docu- 
ments. The fundamental idea behind KAIZEN comes straight from the 
Deming/Shewhart PDCA cycle: 


*KAIZEN isa registered trademark of KAIZEN Institute, Ltd. 
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TOP MANAGEMENT 


IMPROVEMENT 


MIDDLE MANAGEMENT 


SUPERVISORS MAINTENANCE 


WORKERS 


Figure 20.4. Responsibilities and job functions. 


* Someone has an idea for doing the job better (Plan) 

¢ Experiments will be conducted to investigate the idea (Do) 

e The results evaluated to determine if the idea produced the desired result 

(Check) 

¢ Ifso, the SOP will be changed (Act) 

Thus, this “Japanese” approach has its roots well-established in the scientific 
method. The Japanese contribution was to integrate the approach into its 
management systems to assure that it was done routinely, at all levels of the 
organization. Also, the Japanese apply KAIZEN to every process and to the 
entire production cycle, while non-Japanese companies tend to restrict 
improvement to Research and Development or new-process start-ups. Imai lists 
the KAIZEN duties given in Table 20.3 for the different levels in management. 


TOP MANAGEMENT | INNOWATION 


MIDDLE MANAGEMENT 
SUPERVISORS 
MAINTENANCE 


WORKERS 


Figure 20.5. Responsibility for KAIZEN and KAIZEN’s role in process improvement. 
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Table 20.3. Hierarchy of KAIZEN involvement. 


From Imai, M. KAIZEN: The Key to Japan’s Competitive Success, p. 8. Copyright © 1986 


by the KAIZEN Institute, Ltd. 


POSITION 


RESPONSIBILITIES 


Top management 


e Be determined to introduce KAIZEN as a corporate strategy 

e Provide support and direction for KAIZEN by allocating 
resources 

e Establish policy for KAIZEN and cross-functional goals 

e Realize KAIZEN goals through policy deployment and audits 

e Build systems, procedures, and structures conducive to KAIZEN 


Middle e Deploy and implement KAIZEN goals as directed by top 
management management through policy deployment and cross-functional 
management 
e Use KAIZEN in functional capabilities 
e Establish, maintain, and upgrade standards and staff 
e Make employees KAIZEN-conscious through intensive training 
programs 
e Help employees develop skills and tools for problem solving 
Supervisors e Use KAIZEN in functional roles 
e Formulate plans for KAIZEN and provide guidance to workers 
e Improve communication with workers and sustain high morale 
e Support small group activities (such as quality circles) and the 
individual suggestion system 
e Introduce discipline in the workshop 
e Provide KAIZEN suggestions 
Workers e Engage in KAIZEN through the suggestion system and small 


group activities 

e Practice discipline in the workshop 

e Engage in continuous self-development to be better problem 
solvers 

e Enhance skills and job performance expertise with cross- 


education 
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Generally, KAIZEN is implemented via quality improvement teams at 
various levels of management. Individual KAIZEN projects are generally 
not done on a scale that warrants full-blown project management tools 
such as PERT-CPM, but the “7M” tools are often used to manage 
KAIZEN projects. 


BECOMING LEAN: A TACTICAL PERSPECTIVE 


At the strategic level, becoming Lean involves a culture change. Chapters 1 
and 3 provide guidelines for making this transition. An organization ready for 
Six Sigma is also ready for Lean. However, there are some differences in the 
deployment of the Lean model. Here are some guidelines for deploying Lean 
at the process level. 


1. 


Identify the value. Use all known means to determine what existing and 
potential customers really want. 

Map the value stream. Identify how work flows to create the value. 
Determine how information flows to support this process. Identify 
non-value added activities and set goals for reducing muda. 

Distribute work evenly. Balance the process. 

Standardize the process. Identify the core process and eliminate steps 
needed because of unpredictability by minimizing variation, errors, and 
defects. 

Eliminate “Just in case” activities and resources. Schedule Just-In-Time 
deliveries. Stop ordering extra items to deal with uncertainty. Stop hiring 
temps or per diem workers to deal with “unexpected” problems. 
Nurture supplier relationships. Bring the supply chain into the design of 
work processes. Integrate their delivery and information systems with 
yours. 

Use Design for Six Sigma to create breakthrough improvement. 
Remember, you don’t create products or services, you create customers. 
Disregard your investment in existing assets and systems and develop 
entirely new ways to serve your existing customers better, and to create 
new customers. 

Create “autonomation.” Autonomation is Taiichi Ohno’s word to 
describe a production system that mimics the human autonomic 
nervous system, ie., it automatically adjusts to external and internal 
conditions. For example, when we get too hot, our body automatically 
reacts to cool us down; we don’t have to think about it. Similarly, 
production systems should react to customer demands, increasing 
production when demand goes up or decreasing production when 
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demand goes down. They should react to Work-in-Process inventory 
buildup by producing less or producing on a different schedule. Lean 
mechanisms to accomplish this include Takt time, visual controls, 
pull systems, exploiting constraints, etc. 


SIX SIGMA AND LEAN 


Tam sometimes asked to explain the difference between Lean Production and 
Six Sigma. The question is usually phrased something like “Should I use Six 
Sigma or Lean Production methods to improve my operations?” Before I tell 
you my answer to this, let me summarize these two approaches to process 
improvement. Lean Production is based on the Toyota Production System 
(TPS). It usually includes the elements shown in Figure 20.6. When properly 
implemented, a Lean Production system can dramatically improve productivity 
compared with traditional batch-and-queue production systems, in some cases 
by 95%. 

Ok, so how does this relate to Six Sigma? To make the comparison easier we 
need a new way of looking at “quality.” I propose the following definition: 


What is quality? 

Quality is a measure of value added by a productive 
endeavor. Potential quality is the maximum possible 
value added per unit. Actual quality is the current value 
added per unit of input. The difference between potential 


and actual quality is muda. 
Thomas Pyzdek 


By defining quality in terms of value rather than in terms of defects we can see 
that trying to achieve Six Sigma quality, like Lean, involves a search for ways 
to reduce muda. Six Sigma is: 

A general approach to reducing muda in any environment. 

A collection of simple and sophisticated methods for analysis of complex 
cause-and-effect relationships 

A means of discovering opportunities for improvement 

In contrast, Lean offers a proven, pre-packaged set of solutions to muda. Six 
Sigma applies to the problems addressed by Lean, but it also seeks to identify 
and solve other problems. However, since both Six Sigma and Lean address 
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Figure 20.6. Elements of Lean Production. 
Adapted from Hiroyuki Hirano, Editor-in-Chief (1988). JIT Factory Revolution. 
Portland, OR: Productivity Press. 


the problem of muda, there is a great deal of overlap. The two approaches should 
be viewed as complementing one another. Some examples of this synergism 
are shown in Table 20.4. 

In my opinion, if you are facing a situation where Lean solutions can be used, 
you should not hesitate to implement Lean. Lean offers tried-and-true solutions 
to these problems without the need for Black Belt skills. Six Sigma methods 
will help you with Lean, and they will help you continue to improve when it is 
time to move into administrative and other non-production areas. Similarly, if 
you find that Lean isn’t working because of excessive variability or for other, 
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Table 20.4. The synergy of Six Sigma and Lean. 


LEAN SIX SIGMA CONTRIBUTION 
Established methodology for Policy deployment methodology 
improvements 


Focus on customer value stream Customer requirements measurement, 


cross-functional management 


Project-based implementation Project management skills 

Understanding current conditions Knowledge discovery 

Collect product and production data Data collection and analysis tools 

Document current layout and flow Process mapping and flowcharting 

Time the process Data collection tools and techniques, SPC 

Calculate process capacity and Takt time Data collection tools and techniques, SPC 

Create standard work combination sheets Process control planning 

Evaluate the options Cause-and-effect, FMEA 

Plan new layouts Team skills, project management 

Test to confirm improvement Statistical methods for valid comparison, 
SPC 


Reduce cycle times, product defects, 7M tools, 7 QC tools, DOE 
changeover time, equipment failures, etc. 


unknown problems, then use Six Sigma to help identify and address the root 
causes of the trouble. It’s not a choice of Six Sigma or Lean, it’s Six Sigma and 
Lean. 
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Glossary of Basic 
Statistical Terms” 


Acceptable quality level—The maximum percentage or proportion of 
variant units in a lot or batch that, for the purposes of acceptance 
sampling, can be considered satisfactory as a process average. 

Analysis of Variance (ANOVA)—A technique which subdivides the total 
variation of a set of data into meaningful component parts associated 
with specific sources of variation for the purpose of testing some 
hypothesis on the parameters of the model or estimating variance com- 
ponents. 

Assignable cause—A factor which contributes to variation and which is 
feasible to detect and identify. 

Average Outgoing Quality (AOQ)—The expected quality of outgoing 
product following the use of an acceptance sampling plan for a given 
value of incoming product quality. 

Average Outgoing Quality Limit (AOQL)—For a given acceptance sam- 
pling plan, the maximum AOQ over all possible levels of incoming 
quality. 


*From Glossary & Tables for Statistical Quality Control, prepared by the ASQ Statistics Division. Copyright © 1983, ASQ 
Quality Press (800) 248— 1946. Reprinted by permission of the publisher. 


Copyright 2003 by The McGraw-Hill Companies, Inc. Click Here for Terms of Use. 
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Chance causes—Factors, generally numerous and individually of relatively 
small importance, which contribute to variation, but which are not fea- 
sible to detect or identify. 

Coefficient of determination—A measure of the part of the variance for 
one variable that can be explained by its linear relationship with a 
second variable. Designated by p* orr’. 

Coefficient of multiple correlation—A number between 0 and 1 that indi- 
cates the degree of the combined linear relationship of several predictor 
variables X,, X5,.. Xp to the response variable Y. It is the simple corre- 
lation coefficient between predicted and observed values of the 
response variable. 

Coefficient of variation—A measure of relative dispersion that is the stan- 
dard deviation divided by the mean and multiplied by 100 to give a 
percentage value. This measure cannot be used when the data take 
both negative and positive values or when it has been coded in such a 
way that the value X = 0 does not coincide with the origin. 

Confidence limits—The end points of the interval about the sample statistic 
that is believed, with a specified confidence coefficient, to include the 
population parameter. 

Consumer’s risk (B)—For a given sampling plan, the probability of accep- 
tance of a lot, the quality of which has a designated numerical value 
representing a level which it is seldom desired to accept. Usually the 
designated value will be the Limiting Quality Level (LQL). 

Correlation coefficient—A number between —1 and 1 that indicates the 
degree of linear relationship between two sets of numbers: 


ye nYXY—-YiXYLY 


Vey = = 


ey / [pex?— (Cx) pore (cy) 


Defect—A departure of a quality characteristic from its intended level or 
state that occurs with a severity sufficient to cause an associated pro- 
duct or service not to satisfy intended normal, or reasonably foresee- 
able, usage requirements. 

Defective—A unit of product or service containing at least one defect, or 
having several imperfections that in combination cause the unit not to 
satisfy intended normal, or reasonably foreseeable, usage require- 
ments. The word defective is appropriate for use when a unit of product 
or service is evaluated in terms of usage (as contrasted to conformance 
to specifications). 
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Double sampling—Sampling inspection in which the inspection of the first 
sample of size 7,, leads to a decision to accept a lot, not to accept it, or 
to take a second sample of size n,, and the inspection of the second 
sample then leads to a decision to accept or not to accept the lot. 

Experiment design—tThe arrangement in which an experimental program 
is to be conducted, and the selection of the versions (levels) of one 
or more factors or factor combinations to be included in the experi- 
ment. 

Factor—An assignable cause which may affect the responses (test results) 
and of which different versions (levels) are included in the experiment. 

Factorial experiments—Experiments in which all possible treatment 
combinations formed from two or more factors, each being studied at 
two or more versions (levels), are examined so that interactions (differ- 
ential effects) as well as main effects can be estimated. 

Frequency distribution—A set of all the various values that individual 
observations may have and the frequency of their occurrence in the 
sample or population. 

Histogram—A plot of the frequency distribution in the form of rectangles 
whose bases are equal to the cell interval and whose areas are propor- 
tional to the frequencies. 

Hypothesis, alternative—The hypothesis that is accepted if the null 
hypothesis is disproved. The choice of alternative hypothesis will deter- 
mine whether “one-tail” or “two-tail” tests are appropriate. 

Hypothesis, null—The hypothesis tested in tests of significance is that there 
is no difference (null) between the population of the sample and speci- 
fied population (or between the populations associated with each sam- 
ple). The null hypothesis can never be proved true. It can, however, be 
shown, with specified risks of error, to be untrue; that is, a difference 
can be shown to exist between the populations. If it is not disproved, 
one usually acts on the assumption that there is no adequate reason to 
doubt that it is true. (It may be that there is insufficient power to 
prove the existence of a difference rather than that there is no differ- 
ence; that is, the sample size may be too small. By specifying the mini- 
mum difference that one wants to detect and 8, the risk of failing to 
detect a difference of this size, the actual sample size required, however, 
can be determined.) 

In-control process—A process in which the statistical measure(s) being 
evaluated are ina “state of statistical control.” 

Kurtosis—A measure of the shape of a distribution. A positive value indi- 
cates that the distribution has longer tails than the normal distribution 
(platykurtosis); while a negative value indicates that the distribution 


Appendix Table 1—Glossary of basic statistical terms 727 


has shorter tails (leptokurtosis). For the normal distribution, the kurto- 
sis is 0. 

Mean, standard error of—The standard deviation of the average of a sample 
of size n. 


Mean—A measure of the location of a distribution. The centroid. 
Median—The middle measurement when an odd number of units are 
arranged in order of size; for an ordered set X;, X5,..., Xo, 


Median = X, 


When an even number are so arranged, the median is the average of 
the two middle units; for an ordered set X1, X>,..., Xo, 


Xp+Xpi 
2 


Median = 


Mode—The most frequent value of the variable. 

Multiple sampling—Sampling inspection in which, after each sample is 
inspected, the decision is made to accept a lot, not to accept, it or to 
take another sample to reach the decision. There may be a prescribed 
maximum number of samples, after which a decision to accept or not 
to accept must be reached. 

Operating Characteristics curve (OC curve)— 

1. For isolated or unique lots or a lot from an isolated sequence: a 
curve showing, for a given sampling plan, the probability of accept- 
ing a lot as a function of the lot quality. (Type A) 

2. For acontinuous stream of lots: a curve showing, for a given sam- 
pling plan, the probability of accepting a lot as a function of the 
process average. (Type B) 

3. For continuous sampling plans: a curve showing the proportion of 
submitted product over the long run accepted during the sampling 
phases of the plan as a function of the product quality. 

4. For special plans: a curve showing, for a given sampling plan, the 
probability of continuing to permit the process to continue with- 
out adjustment as a function of the process quality. 

Parameter—A constant or coefficient that describes some characteristic of a 
population (e.g., standard deviation, average, regression coefficient). 

Population—The totality of items or units of material under consideration. 
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NOTE: The items may be units or measurements, and the popula- 
tion may be real or conceptual. Thus population may refer to all the 
items actually produced in a given day or all that might be produced if 
the process were to continue in-control. 

Power curve—The curve showing the relation between the probability 
(1 — B) of rejecting the hypothesis that a sample belongs to a given 
population with a given characteristic(s) and the actual population 
value of that characteristic(s). NOTE: if B is used instead of (1 — B), 
the curve is called an operating characteristic curve (OC curve) (used 
mainly in sampling plans for quality control). 

Process capability—The limits within which a tool or process operate based 
upon minimum variability as governed by the prevailing circumstances. 

NOTE: The phrase “by the prevailing circumstances” indicates 
that the definition of inherent variability of a process involving only 
one operator, one source of raw material, etc., differs from one invol- 
ving multiple operators, and many sources of raw material, etc. 
If the measure of inherent variability is made within very restricted 
circumstances, it is necessary to add components for frequently 
occurring assignable sources of variation that cannot economically 
be eliminated. 

Producer’s risk (aw)—For a given sampling plan, the probability of not 
accepting a lot the quality of which has a designated numerical value 
representing a level which it is generally desired to accept. Usually the 
designated value will be the Acceptable Quality Level (AQL). 

Quality—The totality of features and characteristics of a product or service 
that bear on its ability to satisfy given needs. 

Quality assurance—All those planned or systematic actions necessary to 
provide adequate confidence that a product or service will satisfy 
given needs. 

Quality control—The operational techniques and the activities which sus- 
tain a quality of product or service that will satisfy given needs; also 
the use of such techniques and activities. 

Random sampling—The process of selecting units for a sample of size 7 in 
such a manner that all combinations of n units under consideration 
have an equal or ascertainable chance of being selected as the sample. 

R (range)—A measure of dispersion which is the difference between the lar- 
gest observed value and the smallest observed value in a given sample. 
While the range is a measure of dispersion in its own right, it is some- 
times used to estimate the population standard deviation, but is a 
biased estimator unless multiplied by the factor (1 /d,) appropriate to 
the sample size. 
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Replication—The repetition of the set of all the treatment combinations to 
be compared in an experiment. Each of the repetitions is called a repli- 
cate. 

Sample—A group of units, portion of material, or observations taken froma 
larger collection of units, quantity of material, or observations that 
serves to provide information that may be used as a basis for making a 
decision concerning the larger quantity 

Single sampling—Sampling inspection in which the decision to accept or 
not to accept a lot is based on the inspection of a single sample of size n. 

Skewness—A measure of the symmetry of a distribution. A positive value 
indicates that the distribution has a greater tendency to tail to the 
right (positively skewed or skewed to the right), and a negative value 
indicates a greater tendency of the distribution to tail to the left (nega- 
tively skewed or skewed to the left). Skewness is 0 for a normal distribu- 
tion. 

Standard deviation— 

1. G—population standard deviation. A measure of variability 
(dispersion) of observations that is the positive square root of the 
population variance. 

2. s—sample standard deviation. A measure of variability (disper- 
sion) that is the positive square root of the sample variance. 


(pda 3 


Statistic—A quantity calculated from a sample of observations, most often 
to form an estimate of some population parameter. 

Type I error (acceptance control sense)—The incorrect decision that a pro- 
cess is unacceptable when, in fact, perfect information would reveal 
that it is located within the “zone of acceptable processes.” 

Type II error (acceptance control sense)—The incorrect decision that a 
process is acceptable when, in fact, perfect information would reveal 
that it is located within the “zone of rejectable processes.” 

Variance— 

1. 6° —population variance. A measure of variability (dispersion) of 
observations based upon the mean of the squared deviation from 
the arithmetic mean. 

2. s’—sample variance. A measure of variability (dispersion) of 
observations in a sample based upon the squared deviations from 
the arithmetic average divided by the degrees of freedom. 
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Area Under the Standard 
Normal Curve 


Z 0.00 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 


—3.4 || 0.0003 | 0.0003 | 0.0003 | 0.0003 | 0.0003 | 0.0003 | 0.0003 | 0.0003 | 0.0003 | 0.0002 
—3.3 |} 0.0005 | 0.0005 | 0.0005 | 0.0004 | 0.0004 | 0.0004 | 0.0004 | 0.0004 | 0.0004 | 0.0003 
—3.2 || 0.0007 | 0.0007 | 0.0006 | 0.0006 | 0.0006 | 0.0006 | 0.0006 | 0.0005 | 0.0005 | 0.0005 
—3.1 |} 0.0010 | 0.0009 | 0.0009 | 0.0009 | 0.0008 | 0.0008 | 0.0008 | 0.0008 | 0.0007 | 0.0007 
—3.0 |} 0.0013 | 0.0013 | 0.0013 | 0.0012 | 0.0012 | 0.0011 | 0.0011 | 0.0011 | 0.0010 | 0.0010 
—2.9 || 0.0019 | 0.0018 | 0.0018 | 0.0017 | 0.0016 | 0.0016 | 0.0015 | 0.0015 | 0.0014 | 0.0014 
—2.8 |} 0.0026 | 0.0025 | 0.0024 | 0.0023 | 0.0023 | 0.0022 | 0.0021 | 0.0021 | 0.0020 | 0.0019 
—2.7 || 0.0035 | 0.0034 | 0.0033 | 0.0032 | 0.0031 | 0.0030 | 0.0029 | 0.0028 | 0.0027 | 0.0026 
—2.6 || 0.0047 | 0.0045 | 0.0044 | 0.0043 | 0.0041 | 0.0040 | 0.0039 | 0.0038 | 0.0037 | 0.0036 
—2.5 || 0.0062 | 0.0060 | 0.0059 | 0.0057 | 0.0055 | 0.0054 | 0.0052 | 0.0051 | 0.0049 | 0.0048 


Continued on next page... 
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0.00 | 0.01 


0.02 | 003 | 004 | 005 | 006 | 007 | 0.08 


0.09 


0.0082 
0.0107 
0.0139 
0.0179 
0.0228 


0.0080 
0.0104 
0.0136 
0.0174 
0.0222 


0.0078 | 0.0075 | 0.0073 | 0.0071 | 0.0069 | 0.0068 | 0.0066 
0.0102 | 0.0099 | 0.0096 | 0.0094 | 0.0091 | 0.0089 | 0.0087 
0.0132 | 0.0129 | 0.0125 | 0.0122 | 0.0119 | 0.0116 | 0.0113 
0.0170 | 0.0166 | 0.0162 | 0.0158 | 0.0154 | 0.0150 | 0.0146 
0.0217 | 0.0212 | 0.0207 | 0.0202 | 0.0197 | 0.0192 | 0.0188 


0.0064 
0.0084 
0.0110 
0.0143 
0.0183 


0.0287 
0.0359 
0.0446 
0.0548 
0.0668 


0.0281 
0.0351 
0.0436 
0.0537 
0.0655 


0.0274 | 0.0268 | 0.0262 | 0.0256 | 0.0250 | 0.0244 | 0.0239 
0.0344 | 0.0336 | 0.0329 | 0.0322 | 0.0314 | 0.0307 | 0.0301 
0.0427 | 0.0418 | 0.0409 | 0.0401 | 0.0392 | 0.0384 | 0.0375 
0.0526 | 0.0516 | 0.0505 | 0.0495 | 0.0485 | 0.0475 | 0.0465 
0.0643 | 0.0630 | 0.0618 | 0.0606 | 0.0594 | 0.0582 | 0.0571 


0.0233 
0.0294 
0.0367 
0.0455 
0.0559 


0.0808 
0.0968 
0.1151 
0.1357 
0.1587 


0.0793 
0.0951 
0.1131 
0.1335 
0.1562 


0.0778 | 0.0764 | 0.0749 | 0.0735 | 0.0721 | 0.0708 | 0.0694 
0.0934 | 0.0918 | 0.0901 | 0.0885 | 0.0869 | 0.0853 | 0.0838 
0.1112 | 0.1093 | 0.1075 | 0.1056 | 0.1038 | 0.1020 | 0.1003 
0.1314 | 0.1292 | 0.1271 | 0.1251 | 0.1230 | 0.1210 | 0.1190 
0.1539 | 0.1515 | 0.1492 | 0.1469 | 0.1446 | 0.1423 | 0.1401 


0.0681 
0.0823 
0.0985 
0.1170 
0.1379 


0.1841 
0.2119 
0.2420 
0.2743 
0.3085 


0.1814 
0.2090 
0.2389 
0.2709 
0.3050 


0.1788 | 0.1762 | 0.1736 | 0.1711 | 0.1685 | 0.1660 | 0.1635 
0.2061 | 0.2033 | 0.2005 | 0.1977 | 0.1949 | 0.1922 | 0.1894 
0.2358 | 0.2327 | 0.2296 | 0.2266 | 0.2236 | 0.2206 | 0.2177 
0.2676 | 0.2643 | 0.2611 | 0.2578 | 0.2546 | 0.2514 | 0.2483 
0.3015 | 0.2981 | 0.2946 | 0.2912 | 0.2877 | 0.2843 | 0.2810 


0.1611 
0.1867 
0.2148 
0.2451 
0.2776 


0.3446 
0.3821 
0.4207 
0.4602 
0.5000 


0.3409 
0.3783 
0.4168 
0.4562 
0.4960 


0.3372 | 0.3336 | 0.3300 | 0.3264 | 0.3228 | 0.3192 | 0.3156 
0.3745 | 0.3707 | 0.3669 | 0.3632 | 0.3594 | 0.3557 | 0.3520 
0.4129 | 0.4090 | 0.4052 | 0.4013 | 0.3974 | 0.3936 | 0.3897 
0.4522 | 0.4483 | 0.4443 | 0.4404 | 0.4364 | 0.4325 | 0.4286 
0.4920 | 0.4880 | 0.4840 | 0.4801 | 0.4761 | 0.4721 | 0.4681 


0.3121 
0.3483 
0.3859 
0.4247 
0.4641 


0.5000 
0.5398 
0.5793 
0.6179 
0.6554 


0.5040 
0.5438 
0.5832 
0.6217 
0.6591 


0.5080 | 0.5120 | 0.5160 | 0.5199 | 0.5239 | 0.5279 | 0.5319 
0.5478 | 0.5517 | 0.5557 | 0.5596 | 0.5636 | 0.5675 | 0.5714 
0.5871 | 0.5910 | 0.5948 | 0.5987 | 0.6026 | 0.6064 | 0.6103 
0.6255 | 0.6293 | 0.6331 | 0.6368 | 0.6406 | 0.6443 | 0.6480 
0.6628 | 0.6664 | 0.6700 | 0.6736 | 0.6772 | 0.6808 | 0.6844 


0.5359 
0.5753 
0.6141 
0.6517 
0.6879 
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z || 000 | 001 | 002 | 003 | 004 | 005 | 006 | 007 | 008 | 0.09 
0.5 || 0.6915 | 0.6950 | 0.6985 | 0.7019 | 0.7054 | 0.7088 | 0.7123 | 0.7157 | 0.7190 | 0.7224 
0.6 || 0.7257 | 0.7291 | 0.7324 | 0.7357 | 0.7389 | 0.7422 | 0.7454 | 0.7486 | 0.7517 | 0.7549 
0.7 || 0.7580 | 0.7611 | 0.7642 | 0.7673 | 0.7704 | 0.7734 | 0.7764 | 0.7794 | 0.7823 | 0.7852 
0.8 || 0.7881 | 0.7910 | 0.7939 | 0.7967 | 0.7995 | 0.8023 | 0.8051 | 0.8078 | 0.8106 | 0.8133 
0.9 || 0.8159 | 0.8186 | 0.8212 | 0.8238 | 0.8264 | 0.8289 | 0.8315 | 0.8340 | 0.8365 | 0.8389 
1.0 || 0.8413 | 0.8438 | 0.8461 | 0.8485 | 0.8508 | 0.8531 | 0.8554 | 0.8577 | 0.8599 | 0.8621 
1.1. || 0.8643 | 0.8665 | 0.8686 | 0.8708 | 0.8729 | 0.8749 | 0.8770 | 0.8790 | 0.8810 | 0.8830 
1.2 || 0.8849 | 0.8869 | 0.8888 | 0.8907 | 0.8925 | 0.8944 | 0.8962 | 0.8980 | 0.8997 | 0.9015 
1.3 || 0.9032 | 0.9049 | 0.9066 | 0.9082 | 0.9099 | 0.9115 | 0.9131 | 0.9147 | 0.9162 | 0.9177 
1.4 || 0.9192 | 0.9207 | 0.9222 | 0.9236 | 0.9251 | 0.9265 | 0.9279 | 0.9292 | 0.9306 | 0.9319 
15 || 0.9332 | 0.9345 | 0.9357 | 0.9370 | 0.9382 | 0.9394 | 0.9406 | 0.9418 | 0.9429 | 0.9441 
1.6 || 0.9452 | 0.9463 | 0.9474 | 0.9484 | 0.9495 | 0.9505 | 0.9515 | 0.9525 | 0.9535 | 0.9545 
17 || 0.9554 | 0.9564 | 0.9573 | 0.9582 | 0.9591 | 0.9599 | 0.9608 | 0.9616 | 0.9625 | 0.9633 
1.8 || 0.9641 | 0.9649 | 0.9656 | 0.9664 | 0.9671 | 0.9678 | 0.9686 | 0.9693 | 0.9699 | 0.9706 
1.9 || 0.9713 | 0.9719 | 0.9726 | 0.9732 | 0.9738 | 0.9744 | 0.9750 | 0.9756 | 0.9761 | 0.9767 
2.0 || 0.9772 | 0.9778 | 0.9783 | 0.9788 | 0.9793 | 0.9798 | 0.9803 | 0.9808 | 0.9812 | 0.9817 
2.1 || 0.9821 | 0.9826 | 0.9830 | 0.9834 | 0.9838 | 0.9842 | 0.9846 | 0.9850 | 0.9854 | 0.9857 
2.2 || 0.9861 | 0.9864 | 0.9868 | 0.9871 | 0.9875 | 0.9878 | 0.9881 | 0.9884 | 0.9887 | 0.9890 
2.3 || 0.9893 | 0.9896 | 0.9898 | 0.9901 | 0.9904 | 0.9906 | 0.9909 | 0.9911 | 0.9913 | 0.9916 
2.4 || 0.9918 | 0.9920 | 0.9922 | 0.9925 | 0.9927 | 0.9929 | 0.9931 | 0.9932 | 0.9934 | 0.9936 
2.5 || 0.9938 | 0.9940 | 0.9941 | 0.9943 | 0.9945 | 0.9946 | 0.9948 | 0.9949 | 0.9951 | 0.9952 
2.6 || 0.9953 | 0.9955 | 0.9956 | 0.9957 | 0.9959 | 0.9960 | 0.9961 | 0.9962 | 0.9963 | 0.9964 
2.7 || 0.9965 | 0.9966 | 0.9967 | 0.9968 | 0.9969 | 0.9970 | 0.9971 | 0.9972 | 0.9973 | 0.9974 
2.8 || 0.9974 | 0.9975 | 0.9976 | 0.9977 | 0.9977 | 0.9978 | 0.9979 | 0.9979 | 0.9980 | 0.9981 
2.9 || 0.9981 | 0.9982 | 0.9982 | 0.9983 | 0.9984 | 0.9984 | 0.9985 | 0.9985 | 0.9986 | 0.9986 
3.0 || 0.9987 | 0.9987 | 0.9987 | 0.9988 | 0.9988 | 0.9989 | 0.9989 | 0.9989 | 0.9990 | 0.9990 
3.1. || 0.9990 | 0.9991 | 0.9991 | 0.9991 | 0.9992 | 0.9992 | 0.9992 | 0.9992 | 0.9993 | 0.9993 
3.2. || 0.9993 | 0.9993 | 0.9994 | 0.9994 | 0.9994 | 0.9994 | 0.9994 | 0.9995 | 0.9995 | 0.9995 
3.3. || 0.9995 | 0.9995 | 0.9995 | 0.9996 | 0.9996 | 0.9996 | 0.9996 | 0.9996 | 0.9996 | 0.9997 
3.4 || 0.9997 | 0.9997 | 0.9997 | 0.9997 | 0.9997 | 0.9997 | 0.9997 | 0.9997 | 0.9997 | 0.9998 
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Critical Values of the 
t-Distribution 


0 t, 
of 
df 0.1 0.05 0.025 0.01 0.005 
1 3.078 6.314 12.706 31.821 63.657 
2 1.886 2.920 4,303 6.965 9,925 
3 1.638 2.353 3.182 4.541 5.841 
4 1.533 2.132 2.776 3.747 4.604 
5 1.476 2.015 2.571 3.365 4.032 
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Continued ... 
o 

df 0.1 0.05 0.025 0.01 0.005 

6 1.440 1.943 2.447 3.143 3.707 

7 1.415 1.895 2.365 2.998 3.499 

8 1.397 1.860 2.306 2.896 3.355 

9 1.383 1.833 2.262 2.821 3.250 
10 1.372 1.812 2.228 2.764 3.169 
11 1.363 1.796 2.201 2.718 3.106 
12 1.356 1.782 2.179 2.681 3.055 
13 1.350 1.771 2.160 2.650 3.012 
14 1.345 1.761 2.145 2.624 2.977 
15 1.341 1.753 2.131 2.602 2.947 
16 1.337 1.746 2.120 2.583 2.921 
17 1.333 1.740 2.110 2.567 2.898 
18 1.330 1.734 2.101 2.552 2.878 
19 1.328 1.729 2.093 2.539 2.861 
20 1.325 1.725 2.086 2.528 2.845 
21 1.323 1.721 2.080 2.518 2.831 
22 1.321 1.717 2.074 2.508 2.819 
23 1.319 1.714 2.069 2.500 2.807 
24 1.318 1.711 2.064 2.492 2.797 
25 1.316 1.708 2.060 2.485 2.787 
26 1.315 1.706 2.056 2.479 2.779 
27 1.314 1.703 2.052 2.473 2.771 
28 1.313 1.701 2.048 2.467 2.763 
29 1.311 1.699 2.045 2.462 2.756 
(oe) 1.282 1.645 1.960 2.326 2.576 


Chi-Square Distribution 
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Xa 
es 

y 0.995 0.99 0.98 0.975 0.95 0.90 0.80 0.75 0.70 0.50 
0.00004 | 0.000 | 0.001 | 0.001 |) 0.004 | 0.016 | 0.064 | 0.102 | 0.148 | 0.455 

2 {0.0100 | 0.020 | 0.040 |) 0.051 | 0.103 | 0.211 | 0.446 | 0.575 | 0.713 | 1.386 
3 }|0.0717 | 0.115 | 0.185 | 0.216 | 0.352 | 0.584 | 1.005 | 1.213 | 1.424 | 2.366 
4 || 0.207 0.297 | 0.429 | 0.484 | 0.711 1.064 | 1.649 | 1.923 | 2.195 | 3.357 
5 || 0.412 0.554 |) 0.752 | 0.831 1.145 1.610 | 2.343 | 2.675 | 3.000 | 4.351 
6 || 0.676 0.872 | 1.134 | 1.237 | 1.635 | 2.204 | 3.070 | 3.455 | 3.828 | 5.348 
7 {0.989 1.239 | 1.564 | 1.690 | 2.167 | 2.833 | 3.822 | 4.255 | 4.671 | 6.346 
8 || 1.344 1.646 | 2.032 | 2.180 | 2.733 | 3.490 | 4.594 | 5.071 5.527 | 7.344 
9 |) 1.735 2.088 | 2.532 | 2.700 | 3.325 | 4.168 | 5.380 | 5.899 | 6.393 | 8.343 
10 |} 2.156 2.558 | 3.059 | 3.247 | 3.940 | 4.865 | 6.179 | 6.737 | 7.267 | 9.342 
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es 
y 0.995 0.99 0.98 0.975 0.95 0.90 0.80 0.75 0.70 0.50 


11 2.603 | 3.053 | 3.609 | 3.816 | 4.575 | 5.578 | 6.989 | 7.584 | 8.148 | 10.341 
12 3.074 | 3.571 | 4.178 | 4.404 | 5.226 | 6.304 | 7.807 | 8.438 | 9.034 | 11.340 
13 3.565 | 4.107 | 4.765 | 5.009 | 5.892 | 7.042 | 8.634 | 9.299 | 9.926 | 12.340 
14 |} 4.075 | 4.660 | 5.368 | 5.629 | 6.571 | 7.790 | 9.467 | 10.165 | 10.821 | 13.339 
15 4.601 5.229 | 5.985 | 6.262 | 7.261 8.547 | 10.307 | 11.037 | 11.721 | 14.339 
16 5.142 | 5.812 | 6614 | 6.908 | 7.962 | 9.312 | 11.152 | 11.912 | 12.624 | 15.338 
17 5.697 | 6408 | 7.255 | 7.564 | 8.672 | 10.085 | 12.002 | 12.792 | 13.531 | 16.338 
18 6.265 | 7.015 | 7.906 | 8.231 | 9.390 | 10.865 | 12.857 | 13.675 | 14.440 | 17.338 
19 || 6.844 | 7.633 | 8.567 | 8.907 | 10.117 | 11.651 | 13.716 | 14.562 | 15.352 | 18.338 
20 |) 7.434 | 8.260 | 9.237 | 9.591 | 10.851 | 12.443 | 14.578 | 15.452 | 16.266 | 19.337 
21 8.034 | 8.897 | 9.915 | 10.283 | 11.591 | 13.240 | 15.445 | 16.344 | 17.182 | 20.337 
22 8.643 | 9.542 | 10.600 | 10.982 |) 12.338 | 14.041 | 16.314 | 17.240 | 18.101 | 21.337 
23 9.260 | 10.196 | 11.293 | 11.689 | 13.091 | 14.848 | 17.187 | 18.137 | 19.021 | 22.337 
24 |) 9.886 | 10.856 | 11.992 | 12.401 | 13.848 | 15.659 | 18.062 | 19.037 | 19.943 | 23.337 
25 |) 10.520 | 11.524 | 12.697 | 13.120 | 14.611 | 16.473 | 18.940 | 19.939 | 20.867 | 24.337 
26 |) 11.160 | 12.198 | 13.409 | 13.844 | 15.379 | 17.292 | 19.820 | 20.843 | 21.792 | 25.336 
27 || 11.808 | 12.879 | 14.125 | 14.573 | 16.151 | 18.114 | 20.703 | 21.749 | 22.719 | 26.336 
28 || 12.461 | 13.565 | 14.847 | 15.308 | 16.928 | 18.939 | 21.588 | 22.657 | 23.647 | 27.336 
29 |) 13.121 | 14.256 | 15.574 | 16.047 | 17.708 | 19.768 | 22.475 | 23.567 | 24.577 | 28.336 
30 || 13.787 | 14.953 | 16.306 | 16.791 | 18.493 | 20.599 | 23.364 | 24.478 | 25.508 | 29.336 
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le 


0.30 


0.25 


0.20 


0.10 


0.05 


0.025 


0.02 


0.01 


0.005 


0.001 


1.074 
2.408 
3.665 
4.878 
6.064 


1.323 
2.773 
4.108 
5.385 
6.626 


1.642 
3.219 
4.642 
5.989 
7.289 


2.706 
4.605 
6.251 
7.779 
9.236 


3.841 
5.991 
7.815 
9.488 
11.070 


5.024 
7.378 
9.348 
11.143 
12.833 


5.412 
7.824 
9.837 
11.668 
13.388 


6.635 
9.210 
11.345 
13.277 
15.086 


7.879 
10.597 
12.838 
14.860 
16.750 


10.828 
13.816 
16.266 
18.467 
20.515 


Siri nesta 


— 
[@) 


7.231 
8.383 
9.524 
10.656 
11.781 


7.841 
9.037 
10.219 
11.389 
12.549 


8.558 
9.803 
11.030 
12.242 
13.442 


10.645 
12.017 
13.362 
14.684 
15.987 


12.592 
14.067 
15.507 
16.919 
18.307 


14.449 
16.013 
17.535 
19.023 
20.483 


15.033 
16.622 
18.168 
19.679 
21.161 


16.812 
18.475 
20.090 
21.666 
23.209 


18.548 
20.278 
21.955 
23.589 
25.188 


22.458 
24.322 
26.124 
27.877 
29.588 


ee Se Re Se 
mn BW NY 


12.899 
14.011 
15.119 
16.222 
17.322 


13.701 
14.845 
15.984 
17.117 
18.245 


14.631 
15.812 
16.985 
18.151 
19.311 


17.275 
18.549 
19.812 
21.064 
22.307 


19.675 
21.026 
22.362 
23.685 
24.996 


21.920 
23.337 
24.736 
26.119 
27.488 


22.618 
24.054 
25.472 
26.873 
28.259 


24.725 
26.217 
27.688 
29.141 
30.578 


26.757 
28.300 
29.819 
31.319 
32.801 


31.264 
32.909 
34.528 
36.123 
37.697 


oO Fe Be Re Be 
Oo © AN BD 


18.418 
19.511 
20.601 
21.689 
22.775 


19.369 
20.489 
21.605 
22.718 
23.828 


20.465 
21.615 
22.760 
23.900 
25.038 


23.542 
24.769 
25.989 
27.204 
28.412 


26.296 
27.587 
28.869 
30.144 
31.410 


28.845 
30.191 
31.526 
32.852 
34.170 


29.633 
30.995 
32.346 
33.687 
35.020 


32.000 
33.409 
34.805 
36.191 
37.566 


34.267 
35.718 
37.156 
38.582 
39.997 


39.252 
40.790 
42.312 
43.820 
45.315 
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23.858 
24.939 
26.018 
27.096 
28.172 


24.935 
26.039 
27.141 
28.241 
29.339 


26.171 
27.301 
28.429 
29.553 
30.675 


29.615 
30.813 
32.007 
33.196 
34.382 


32.671 
33.924 
35.172 
36.415 
37.652 


35.479 
36.781 
38.076 
39.364 
40.646 


36.343 
37.659 
38.968 
40.270 
41.566 


38.932 
40.289 
41.638 
42.980 
44.314 


41.401 
42.796 
44.181 
45.559 
46.928 


46.797 
48.268 
49.728 
51.179 
52.620 
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29.246 
30.319 
31.391 
32.461 
33.530 


30.435 
31.528 
32.620 
33.711 
34.800 


31.795 
32.912 
34.027 
35.139 
36.250 


35.563 
36.741 
37.916 
39.087 
40.256 


38.885 
40.113 
41.337 
42.557 
43.773 


41.923 
43.195 
44.461 
45.722 
46.979 


42.856 
44.140 
45.419 
46.693 
47.962 


45.642 
46.963 
48.278 
49.588 
50.892 


48.290 
49.645 
50.993 
52.336 
53.672 


54.052 
55.476 
56.892 
58.301 
59.703 
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Poisson Probability Sums 
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Continued ... 
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THE COMPLETE GUIDE TO SIX SIGMA 


Continued ... 
Lu 
r 55 6.0 6.5 7.0 | 75 8.0 8.5 9.0 9.5 
15 |] 0.9998 | 0.9995 | 0.9988 | 0.9976 | 0.9954 | 0.9918 | 0.9862 | 0.9780 | 0.9665 
16 || 0.9999 | 0.9998 | 0.9996 | 0.9990 | 0.9980 | 0.9963 | 0.9934 | 0.9889 | 0.9823 
17 || 1.0000 | 0.9999 | 0.9998 | 0.9996 | 0.9992 | 0.9984 | 0.9970 | 0.9947 | 0.9911 
18 |} 1.0000 | 1.0000 | 0.9999 | 0.9999 | 0.9997 | 0.9993 | 0.9987 | 0.9976 | 0.9957 
19 |} 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9997 | 0.9995 | 0.9989 | 0.9980 
20 |} 1.0000 | 1.0000 |} 1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9998 | 0.9996 | 0.9991 
21 1.0000 | 1.0000 |} 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9998 | 0.9996 
22 || 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9999 
23 |} 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 
24 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 
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Appendix Table 7—Poisson probability sums 
Continued ... 
Ll 

r 10.0 11.0 12.0 13.0 14.0 15.0 16.0 17.0 18.0 

21 || 0.9993 | 0.9977 | 0.9939 | 0.9859 | 0.9712 | 0.9469 | 0.9108 | 0.8615 | 0.7991 
22 || 0.9997 | 0.9990 | 0.9970 | 0.9924 | 0.9833 | 0.9673 | 0.9418 | 0.9047 | 0.8551 
23 || 0.9999 | 0.9995 | 0.9985 | 0.9960 | 0.9907 | 0.9805 | 0.9633 | 0.9367 | 0.8989 
24 | 1.0000 | 0.9998 | 0.9993 | 0.9980 | 0.9950 | 0.9888 | 0.9777 | 0.9594 | 0.9317 
25 1.0000 | 0.9999 | 0.9997 | 0.9990 | 0.9974 | 0.9938 | 0.9869 | 0.9748 | 0.9554 
26 |} 1.0000 | 1.0000 | 0.9999 | 0.9995 | 0.9987 | 0.9967 | 0.9925 | 0.9848 | 0.9718 
27 |} 1.0000 | 1.0000 | 0.9999 | 0.9998 | 0.9994 | 0.9983 | 0.9959 | 0.9912 | 0.9827 
28 || 1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9997 | 0.9991 | 0.9978 | 0.9950 | 0.9897 
29 || 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9996 | 0.9989 | 0.9973 | 0.9941 
30 |} 1.0000 | 1.0000 |} 1.0000 | 1.0000 | 0.9999 | 0.9998 | 0.9994 | 0.9986 | 0.9967 
31 1.0000 | 1.0000 | 1.0000 | 1.0000 |} 1.0000 | 0.9999 | 0.9997 | 0.9993 | 0.9982 
32 |} 1.0000 | 1.0000 |} 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9996 | 0.9990 
33 |} 1.0000 | 1.0000 } 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9998 | 0.9995 
34 | 1.0000 | 1.0000 } 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 | 0.9998 
35 |} 1.0000 | 1.0000 |} 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 
36 |} 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 0.9999 
37 |} 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 | 1.0000 
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Tolerance Interval Factors 


Table 8.1a. Values of & for two-sided limits. 


y=0.90 ¥=0.95 y=0.99 

n P=0.95 | P=0.99 [P=0.999 P=0.95 | P=0.99 [P=0.999| P=0.90 | P=0.95 | P=0.99 

2 |[ 15.978 | 18.800 | 24.167 | 30.227 | 32.019 | 37.674 | 48.430 | 60.573 | 160.193 | 188.491 | 242.300 | 303.054 
3|| 5847 | 6919 | 8.974 | 11309 | 8.380 | 9.916 | 12.861 | 16.208 | 18.930] 22.401 | 29.055| 36.616 
4]| 4166 | 4.943 | 6440] 8.149 | 5.369 | 6370 | 8.299 | 10.502 | 9.398] 11.150] 14.527] 18.383 
5 || 3.494] 4152 | 5.423 | 6879 | 4.275 | 5.079 | 6634] 8415 | 6612| 7.855] 10.260] 13.015 
6 || 3131 | 3.723 | 4.870 | 6188 | 3712 | 4414) 5775 | 7.337 | 5337] 6345] 8301| 10548 
7 {|| 2902 | 3.452 | 4.521 | 5.750] 3369 | 4.007 | 5.248] 6676 | 4.613] 5488] 7.187] 9.142 
8 || 2.743 | 3.264 | 4278 | 5.446 | 3.316] 3.732 | 4891 | 6226 | 4147] 4.936] 6468] 8.234 
9|| 2626 | 3125 | 4.098 | 5.220] 2.967] 3532 | 4631 | 5.899 | 3.822] 4.550| 5.966| 7.600 
10 || 2535 | 3.018 | 3.959 | 5.046] 2839 | 3379 | 4.433 | 5.649] 3.582] 4265/ 5594] 7.129 
i1 || 2463 | 2.933 | 3.849 | 4.906 | 2737 | 3259 | 4.277| 5452] 3.397] 4045/ 5308| 6.766 
12 || 2.404 | 2863 | 3.758 | 4.792 | 2655 | 3162] 4.150] 5.291 | 3.250| 3.870| 5.079] 6.477 
13 || 2.355 | 2805 | 3.682 | 4.697 | 2587 | 3.081 | 4.044] 5.158 | 3130| 3.727| 4.893] 6.240 
14 || 2314 | 2756 | 3.618 | 4615] 2529 | 3.012 | 3.955 | 5.045] 3.029] 3608] 4737] 6.043 
15 || 2.278 | 2713 | 3.562 | 4.545 | 2480 | 2.954] 3.878 | 4.949 | 2.945| 3.507| 4.605| 5.876 
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Table 8.1a—Continued .. . 


y = 0.90 y = 0.95 7 = 0.99 
n |} P=0.90 | P=0.95 | P=0.99 |P=0.999| P=0.90 | P=0.95 [P 0.99 |P=0.999| P=0.90 | P=0.95 | P=0.99 |P=0.999 


Table 8.1b. Values of k for one-sided limits. 
y = 0.90 y = 0.95 y = 0.99 


n || P=0.90 | P=0.95 P=0.999| P=0.90 | P=0.95 | P=0.99 |[P=0.999} P=0.90 | P=0.95 | P=0.99 |P=0.999 


3 || 4.258 5.310 | 7.340 | 9.651 6.158 | 7.655 | 10.552 | 13.857 

4 || 3.187 | 3.957 | 5.437 | 7.128 | 4.163 | 5.145 7.042 | 9.215 

5 || 2.742 | 3.400 | 4.666 | 6.112 | 3.407 | 4.202 5.741 7.501 

6 || 2.494 | 3.091 4.242 | 5.556 | 3.006 | 3.707 | 50.62 6.612 | 4.408 5.409 | 7.334 | 9.540 
7 

8 

9 


2.333 | 2.894 | 3.972 | 5.201 2.755 | 3.399 4.641 6.061 | 3.856 | 4.730 | 6.411 8.348 
2.219 | 2.755 | 3.783 | 4.955 | 2.582 | 3.188 4.353 | 5.686 | 3.496 | 4.287 | 5.811 | 7.566 
2.133 | 2.649 | 3.641 4.772 | 2.454 | 3.031 4.143 | 5.414 | 3.242 | 3.971 5.389 | 7.014 
10 |} 2.065 | 2.568 3.532 | 4.629 | 2.355 | 2.911 3.981 5.203 | 3.048 3.739 | 5.075 | 6.603 


Continued on next page... 
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THE COMPLETE GUIDE TO SIX SIGMA 


Table 8.1b—Continued . . . 


y = 0.90 y = 0.95 7 = 0.99 
n || P=0.90 | P=0.95 | P=0.99 |P=0.999| P=0.90 | P=0.95 | P=0.99 IP 0.999 | P=0.90 | P=0.95 | P=0.99 |P=0.999 
11 2.012 2.503 3.444 4.515 2.275 2.815 3.852 5.036 2.897 3.557 4.828 6.284 
12 1.966 2.448 3.371 4.420 2.210 2.736 3.747 4.900 2.773 3.410 4.633 6.032 
13 1.928 2.403 3.310 4.341 2.155 2.670 3.659 4.787 2.677 3.290 4.472 5.826 
14 1.895 2.363 3.257 4.274 2.108 2.614 3.585 4.690 2.592 3.189 4.336 5.651 
15 1.866 2.329 3.212 4.215 2.068 2.566 3.520 4.607 2.521 3.102 4.224 5.507 
16 1.842 2.299 3.172 4.146 2.032 2.523 3.463 4.534 2.458 3.028 4.124 5.374 
17 1.820 2.272 3.136 4.118 2.001 2.468 3.415 4.471 2.405 2.962 4.038 5.268 
18 1.800 2.249 3.106 4.078 1.974 2.453 3.370 4.415 2.357 2.906 3.961 5.167 
19 1.781 2.228 3.078 4.041 1.949 2.423 3.331 4.364 2.315 2.855 3.893 5.078 
20 1.765 2.208 3.052 4.009 1.926 2.396 3.295 4.319 2.275 2.807 3.832 5.003 
21 1.750 2.190 3.028 3.979 1.905 2.371 3.262 4.276 2.241 2.768 3.776 4.932 
22 1.736 2.174 3.007 3.952 1.887 2.350 3.233 4.238 2.208 2.729 3.727 4.866 
23 1.724 2.159 2.987 3.927 1.869 2.329 3.206 4.204 2.179 2.693 3.680 4.806 
24 1.712 2.145 2.969 3.904 1.853 2.309 3.181 4.171 2.154 2.663 3.638 4.755 
25 1.702 2.132 2.952 3.882 1.838 2.292 3.158 4.143 2.129 2.632 3.601 4.706 
30 1.657 2.080 2.884 3.794 1.778 2.220 3.064 4.022 2.029 2.516 3.446 4.508 
35 1.623 2.041 2.833 3.730 1.732 2.166 2.994 3.934 1.957 2.431 3.334 4.364 
40 1.598 2.010 2.793 3.679 1.697 2.126 2.941 3.866 1.902 2.365 3.250 4.255 
45 1.577 1.986 2.762 3.638 1.669 2.092 2.897 3.811 1.857 2.313 3.181 4.168 
50 1.560 1.965 2.735 3.604 1.646 2.065 2.963 3.766 1.821 2.296 3.124 4.096 
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Table 8.2. Proportion of population covered with y% 
confidence and sample size n. 


n y = 0.90 y = 0.95 y = 0.99 y = 0.995 
2 0.052 0.026 0.006 0.003 
4 0.321 0.249 0.141 0.111 
6 0.490 0.419 0.295 0.254 
10 0.664 0.606 0.496 0.456 
20 0.820 0.784 0.712 0.683 
40 0.907 0.887 0.846 0.829 
60 0.937 0.924 0.895 0.883 
80 0.953 0.943 0.920 0.911 
100 0.962 0.954 0.936 0.929 
150 0.975 0.969 0.957 0.952 
200 0.981 0.977 0.968 0.961 
500 0.993 0.991 0.987 0.986 
1000 0.997 0.996 0.994 0.993 


Table 8.3. Sample size required to cover (1—a)% of the population with y% 
confidence. 
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Durbin-Watson Test Bounds 


Table 9.1. Level of significance % = .05 


p-1=1 p-1=2 p-1=3 p-1=4 p-1=5 
n dy dy dr dy dr dy dr dy dy dy 


15 1.08 1.36 0.95 1.54 0.82 1.75 0.69 1.97 0.56 2.21 
16 1.10 1.37 0.98 1.54 0.86 1.73 0.74 1.93 0.62 2.15 
17 1.13 1.38 1.02 1.54 0.90 1.71 0.78 1.90 0.67 2.10 
18 1.16 1.39 1.05 1.53 0.93 1.69 0.82 1.87 0.71 2.06 
19 1.18 1.40 1.08 1.53 0.97 1.68 0.86 1.85 0.75 2.02 


20 1.20 1.41 1.10 1.54 1.00 1.68 0.90 1.83 0.79 1.99 
21 1.22 1.42 1.13 1.54 1.03 1.67 0.93 1.81 0.83 1.96 
22 1.24 1.43 1.15 1.54 1.05 1.66 0.96 1.80 0.86 1.94 
23 1.26 1.44 1.17 1.54 1.08 1.66 0.99 1.79 0.90 1.92 
24 1.27 1.45 1.19 1.55 1.10 1.66 1.01 1.78 0.93 1.90 


25 1.29 1.45 1.21 1.55 1.12 1.66 1.04 1.77 0.95 1.89 
26 1.30 1.46 1.22 1.55 1.14 1.65 1.06 1.76 0.98 1.88 
27 1.32 1.47 1.24 1.56 1.16 1.65 1.08 1.76 1.01 1.86 
28 1.33 1.48 1.26 1.56 1.18 1.65 1.10 1.75 1.03 1.85 
29 1.34 1.48 1.27 1.56 1.20 1.65 1.12 1.74 1.05 1.84 
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Table 9.1—Continued .. . 


p-1=2 p-1=3 p-1=4 p-1=5 

dy dy dy dy dy dy dy dy 
1.28 1.57 1.21 1.65 1.14 1.74 1.07 1.83 
1.30 1.57 1.23 1.65 1.16 1.74 1.09 1.83 
1.31 1.57 1.24 1.65 1.18 1.73 1.11 1.82 
1.32 1.58 1.26 1.65 1.19 1.73 1.13 1.81 
1.33 1.58 1.27 1.65 1.21 1.73 1.15 1.81 
1.34 1.58 1.28 1.65 1.22 1.73 1.16 1.80 
1.35 1.59 1.29 1.65 1.24 1.73 1.18 1.80 
1.36 1.59 1.31 1.66 1.25 1.72 1.19 1.80 
1.37 1.59 1.32 1.66 1.26 1.72 1.21 1.79 
1.38 1.60 1.33 1.66 1.27 1.72 1.22 1.79 


1.39 1.60 1.34 1.66 1.29 1.72 1.23 1.79 
1.43 1.62 1.38 1.67 1.34 1.72 1.29 1.78 
1.46 1.63 1.42 1.67 1.38 1.72 1.34 1.77 
1.49 1.64 1.45 1.68 1.41 1.72 1.38 1.77 
1.51 1.65 1.48 1.69 1.44 1.73 1.41 1.77 
1.54 1.66 1.50 1.70 1.47 1.73 1.44 1.77 
1.55 1.67 1.52 1.70 1.49 1.74 1.46 1.77 
1.57 1.68 1.54 1.71 1.51 1.74 1.49 1.77 
1.59 1.69 1.56 1.72 1.53 1.74 1.51 1.77 
1.60 1.70 1.57 1.72 1.55 1.75 1.52 1.77 
1.61 1.70 1.59 1.73 1.57 1.75 1.54 1.78 
1.62 1.71 1.60 1.73 1.58 1.75 1.56 1.78 
1.63 1.72 1.61 1.74 1.59 1.76 1.57 1.78 
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Table 9.2. Level of significance & = .01. 
p-1=2 p-1=3 p-1=4 p-1=5 
n dr dy dr dy dr dy dr dy 
15 0.70 1.25 0.59 1.46 0.49 1.70 0.39 1.96 
16 0.74 1.25 0.63 1.44 0.53 1.66 0.44 1.90 
17 0.77 1.25 0.67 1.43 0.57 1.63 0.48 1.85 
18 0.80 1.26 0.71 1.42 0.61 1.60 0.52 1.80 
19 0.83 1.26 0.74 1.41 0.65 1.58 0.56 1.77 
20 0.86 1.27 0.77 1.41 0.68 1.57 0.60 1.74 
21 0.89 1.27 0.80 1.41 0.72 1.55 0.63 1.71 
22 0.91 1.28 0.83 1.40 0.75 1.54 0.66 1.69 
23 0.94 1.29 0.86 1.40 0.77 1.53 0.70 1.67 
24 0.96 1.30 0.88 1.41 0.80 1.53 0.72 1.66 
25 0.98 1.30 0.90 1.41 0.83 1.52 0.75 1.65 
26 1.00 1.31 0.93 1.41 0.85 1.52 0.78 1.64 
27 1.02 1.32 0.95 1.41 0.88 1.51 0.81 1.63 
28 1.04 1.32 0.97 1.41 0.90 1.51 0.83 1.62 
29 1.05 1.33 0.99 1.42 0.92 1.51 0.85 1.61 
30 1.07 1.34 1.01 1.42 0.94 1.51 0.88 1.61 
31 1.08 1.34 1.02 1.42 0.96 1.51 0.90 1.60 
32 1.10 1.35 1.04 1.43 0.98 1.51 0.92 1.60 
33 1.11 1.36 1.05 1.43 1.00 1.51 0.94 1.59 
34 1.13 1.36 1.07 1.43 1.01 1.51 0.95 1.59 
35 1.14 1.37 1.08 1.44 1.03 1.51 0.97 1.59 
36 1.15 1.38 1.10 1.44 1.04 1.51 0.99 1.59 
37 1.16 1.38 1.11 1.45 1.06 1.51 1.00 1.59 
38 1.18 1.39 1.12 1.45 1.07 1.52 1.02 1.58 
39 1.19 1.39 1.14 1.45 1.09 1.52 1.03 1.58 
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Table 9.2—Continued .. . 


p-1=1 p-1=2 p-1=3 p-1=4 p-1=5 

n dy dy dy dy dy dy dy dy dy dy 
400) 25-134 1.20 1.40 1.15 1.46 1.10 1.52 1.05 1.58 
45 1.29 = 1.38 1.24 1.42 1.20 1.48 1.16 1.53 1.11 1.58 
50 || 1.32 1.40 1.28 1.45 1.24 1.49 1.20 1.54 1.16 1.59 
55 1.36 = 1.43 1.32 1.47 1.28 1.51 1.25 1.55 1.21 1.59 
60 |) 1.38 1.45 1.35 1.48 1.32 1.52 1.28 1.56 1.25 1.60 
65 1.41 1.47 1.38 1.50 1,35 1.53 1.31 TdF 1.28 1.61 
70 || 1.43 1.49 1.40 1.52 1,37 1.55 1.34 1.58 1.31 1.61 
75 145 = 1.50 1.42 1.53 £39 1.56 L37. 1.59 1.34 1.62 
80 || 1.47 1.52 1.44 1.54 1.42 1.57 1.39 1.60 1.36 1.62 
85 148 = 1.53 1.46 1.55 1.43 1.58 1.41 1.60 1.39 1.63 


90 1.50 1.54 1.47 1.56 1.45 1.59 1.43 1.61 1.41 1.64 
95 1.51 1.55 1.49 1.57 1.47 1.60 1.45 1.62 1.42 1.64 
100 1.52 1.56 1.50 1.58 1.48 1.60 1.46 1.63 1.44 1.65 
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Control Chart Constants 
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Continued ... 
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Control Chart Equations 


np CHART p CHART 
; fap) 
= eRe cn gee LCL =p —3,fP—P 
: 
or 0 if LCL is negative GE DULG D aceaye 
g 
4 _ Sum of items with problems _ Sum of items with problems 
H n — — 
3 P Number of subgroups P= Nuriber ob items in al subgroups 
S 
p Se Caer 2) 
fe UCL = np +3 (1-2) eee ae eer 
2 i‘ 
or n if UCL is greater than n Of OG Lae greater than) 
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Continued ... 


c CHART u CHART 


u 
3 LCL =t—3V¢ Le = 4-3," 
Oo : : , a 
us or 0 if LCL is negative sped Win menie 
a 
4 ets Sum of problems — Sum of problems 
3 ~ Number of subgroups ~ Number of units in all subgroups 
: 
5 u 
5 UCL =é + 3Vé UCL =i +3,/- 

n 


X CHART X CHART 


LCL = X — 2.66(MR) 


LCL=X—A,R 


ra Sum of measurements 


Number of measurements 


a Sum of subgroup averages 
~ Number of averages 


UCL = X + 2.66(MR) 


UCL) Center Line |LCL 


UCL =X+A3R 


R CHART 


LCL =D:R 


= Sum of ranges 
R= 


Number of ranges 


UCL | Center Line | LCL 


UCL =D,R 
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Table of d} Values 


m = repeat readings taken 
2 3 4 5 6 7 8 
1 2.96 
2 2.91 
3 2.89 
4 2.88 
” 5 2.87 
6 
5 6 2.87 
vo 
oe 7 2.87 
= 2.87 
8 : 

+ 
x 9 2.86 
£] 10 
a. 

+ 11 1.71 2.08 2.34 2.55 2.72 2.86 
\| 12 1.15 1.71 2.07 2.34 2.55 2.72 2.85 
7 13 1.15 1.71 2.07 2.34 2.55 2.71 2.85 

14 1.15 1.71 2.07 2.34 2.54 2.71 2.85 
15 1.15 1.71 2.07 2.34 2.54 2.71 2.85 
1.128 2.059 2.534 2.847 
1.693 2.326 2.704 
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Continued ... 


m = repeat readings taken 


9 10 11 12 13 14 15 
1 |) 3.08 | 3.18 | 3.27 | 3.35 
2 || 302 | 3143 | 3.22 | 3.30 
3 || 301 | 3.41 | 3.21 3.29 
4 || 300 | 310 | 3.20 | 3.28 
5 || 2.99 | 340 | 3.19 | 3.28 
g 6 || 299 | 340 | 319 | 3.27 
a. 7 || 299 | 340 | 3149 | 3.27 
- 8 || 2.98 | 3.09 | 319 | 3.27 
x 9 || 2.98 | 3.09 | 318 | 3.27 
= 10 || 2.98 | 3.09 | 3.18 3.27 
+e 11 || 2.98 | 3.09 3.18 3.27 
i 12 || 2.98 | 3.09 | 318 | 3.27 
= 13 || 2.98 | 3.09 | 318 | 3.27 
14 || 2.98 | 3.08 | 318 | 3.27 
15 || 2.98 | 3.08 | 318 | 3.26 

>15 3.078 3.258 3.407 
2.970 3.173 3.336 3.472 
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Power Functions for 
ANOVA 


(Graphs on the pages to follow.) 
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Table 14.1.0, = 1. 
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Table 14.2.0, = 2. 
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Table 14.4.0, = 4. 
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Table 14.5.0, = 5. 
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Table 14.8.0, = 8. 
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Factors for Short Run 
Control Charts for 
Individuals, X-bar, 

and R Charts 


SUBGROUP SIZE 


Oo AN DO FW NY 


ma 
oO 


No Re 
own 


i) 
wm 


Numbers enclosed in bold boxes represent the recommended minimum number of subgroups for starting a control chart. 
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Continued ... 
SUBGROUP SIZE 
g 4 

Age | Dar | Ars | Das | Aor | Dar | Ars | Das 
1|| NA | NA | 305 | 13 | NA | NA /18 | 51 
2//083 | 19 | 144 | 35 | 058 | 17 | 10 | 32 
3//081 | 19 | 144 | 32 | 059 | 18 | 083 | 28 
4l/079 | 21 | 1o1 | 29 | 059 | 19 | 076 | 26 
5 || 078 | 21 | 095 | 28 | 059 | 20 | 072 | 25 
6 || 077 | 22 | 091 | 27 0.70 | 2.4 
7 0.88 | 26 | 0.59 | 2.0 | 068 | 24 
8 || 0.76 | 22 | 086 | 26 | 059 | 20 | 066 | 23 
9 || 0.76 | 22 | 085 | 25 | 059 | 20 | 065 | 23 
10 || 0.75 | 22 | 083 | 25 | 058 | 20 | 065 | 23 
15 || 0.75 | 23 | 080 | 24 | 058 | 21 | 062 | 22 
20 || 0.74 | 23 | 078 | 24 | 058 | 24 | 061 | 2.2 
25 || 0.74 | 23 | 077 | 24 | 058 | 241 | 060 | 22 


Numbers enclosed in bold boxes represent the recommended minimum number of subgroups for starting a control chart. 
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Significant Number of 
Consecutive Highest 
or Lowest Values from 
One Stream of a 
Multiple-Stream Process 


On average a run of the length shown would appear no more than 1 time in 100. 
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Sample Customer Survey 


Taken from How did we do?, a patient satisfaction survey for the XXX 
Community Hospital. (3/15/94) 


For each of the following statements, please check 


the appropriate box. 


vo 
vo 
ha 
: : : 
Mark the NA box if you had no opportunity to bb bp ® 3 
. : oD 
judge that aspect of care during your stay at XXX > eS 9 bs 
C ity Hospital +. 2. Se o> 
ommunity Hospital. 5 o 3. —_— 
| fete) 7, ° a) bert 
nA < FQ A 4 


I received my medication on time 
The menu offered foods I liked 
My doctor kept me informed 


My room was clean 


The discharge process was smooth 


My doctor was available 


Continued on next page... 
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Continued ... 

oO 

oO 
o oO 5p 
ha 2 wo By 

oO . 
= eb 3 
2 35 o = 
2 g 83 & ®& 
oo eal 

5 = 3 5 (le 5 « 
vn < £ A Gf @ 


The hospital was well supplied 
I received the foods I selected from the menu 


The staff answered my call light quickly 


The food looked good 
I was informed of what I should do after discharge 


My bed was comfortable 


The hospital staff took good care of me 
I knew my doctor’s name 


The staff treated one another with respect 


The hospital was well maintained 
The food tasted good 


My medications were ready when I was ready to go 


The billing procedures were explained to me 
I was served the right amount of food 


The nurse checked on me frequently 


I had assistance making plans to leave the hospital 


My doctor told me when I was going home 


The food servers were pleasant 


Continued on next page... 


The hospital was clean 
Overall, the hospital staff treated me with respect 


My room was quiet 


The staff met my special needs 
The attitude of the staff was nice 


I was escorted out of the hospital at discharge 
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Continued ... 
o 
vo 
vo i) bb 
vo o igs) 
u 4 UV vn 
5 pe 
cg g so S ¢ 
5 ob 0 6 sf 5 < 
n gq Zs A n Zz 


My room was comfortable 
My diet was what the doctor ordered 


The staff kept me informed about my care 


I was satisfied with my doctor(s) 


Meals were served on time 


The staff were helpful 


The discharge process was speedy 
My doctor knew who I was 


My medications/wound care/equipment were explained to me | 


I was treated well 
I was prepared to go home 


The staff were attentive to my needs 


Continued on next page... 


776 THE COMPLETE GUIDE TO SIX SIGMA 


Continued ... 
vo 
oO 
o v ob 
Sp £8 3 
od a bb ba 
cm u 8 o b> 
—_ oO oc) uo —_ 
ae g SO & ®& 
g = S 5 (lB s << 
vn < =£ A & @ 


Thad the same doctor(s) throughout my hospitalization 


The nurses acted in a professional manner 


The staff knew what care I needed 


I would refer a family member to XXX 


Community Hospital 


I would choose to come back to XXX Community 


Hospital 


Were there any incidents you remember from your stay that were especially 
PLEASANT? 


Were there any incidents you remember from your stay that were especially 
UNPLEASANT? 


We welcome any other suggestions you have to offer. 


Thank you for your assistance! 
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Process 6 Levels 
and Equivalent PPM 


Quality Levels 


Based on the assumption that in the long term the process could drift by plus or minus 


1.50. 
Process G Process O Process 6 
Level Process PPM Level Process PPM Level Process PPM 
6.27 1 5.27 80 3.96 7,000 
6.12 2 5.25 90 3.91 8,000 
6.0 3.4 5.22 100 3.87 9,000 
5.97 4 5.04 200 3.83 10,000 
5.91 5 4.93 300 3.55 20,000 
5.88 6 4.85 400 3.38 30,000 
5.84 7 4.79 500 3.25 40,000 
5.82 8 4.74 600 3.14 50,000 
5.78 9 4.69 700 3.05 60,000 
5.77 10 4.66 800 2.98 70,000 
5.61 20 4.62 900 2.91 80,000 
5.51 30 4.59 1,000 2.84 90,000 
5.44 40 4.38 2,000 2.78 100,000 
5.39 50 4.25 3,000 2.34 200,000 
5.35 60 4.15 4,000 2.02 300,000 
5.31 70 4.08 5,000 1.75 400,000 
Catndi 4.01 6,000 1.50 500,000 


Continued ... 
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Black Belt Effectiveness 
Certification 


Black Belt Certification Recommendation 


Name (as it will appear on the certificate) 
Address 
City State , Zip 


Social Security Number 


We the undersigned, on behalf of , the Six Sigma 


organization, certify the above named individual as a Six Sigma Black Belt within 


[COMPANY]. 


Printed or typed Board Date 
member name Signature Signed 
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[COMPANY] BLACK BELT SKILL SET CERTIFICATION 
PROCESS 
Introduction 


This document describes the process and provides the minimum acceptable 
criteria for certifying an individual as a [COMPANY] Six Sigma Black Belk. 
[COMPANY] certification involves recognition by the [COMPANY] and his 
or her peers, and should not be construed as a professional license. 


Process 
The [COMPANY] determines recognition as a [COMPANY] Six Sigma 
Black Belt. [COMPANY] certification requires that the applicant pass the 
[COMPANY] Black Belt examination. The exam covers the core skill set of 
the Black Belt Body of Knowledge (BOK) as defined by the [COMPANY]. 
The [COMPANY] will score the candidate and determine if their score meets 
the [COMPANY]’s minimum passing score for each section of the BOK, as 
well as for the overall score. The [COMPANY] also provides criteria for asses- 
sing the candidate’s effectiveness by evaluating his or her 
Ability to achieve significant, tangible results by applying the Six Sigma 
approach 
Ability to lead organizational change as demonstrated by the candidate’s 
leadership, teamwork, project management, and communication skills. 
The exam will be administered by the Six Sigma organization. The Six Sigma 
organization is responsible for assuring the integrity of the exam, verifying the 
identity of the candidate sitting for the exam, and enforcing time limits. The 
Six Sigma organization will evaluate the candidate’s effectiveness using the 
[COMPANY] requirements and will notify the [COMPANY] when a candi- 
date who has passed the [COMPANY] BOK exam has met the effectiveness 


requirements. 


[COMPANY] BLACK BELT EFFECTIVENESS 


CERTIFICATION CRITERIA 

This section describes the criteria for certifying that a [COMPANY] Black 
Belt candidate is “effective” in applying the Six Sigma approach. Effectiveness 
means that the candidate has demonstrated the ability to lead the change pro- 
cess by successfully applying Six Sigma methodologies on more than one signif- 
icant project. Success is demonstrated by achieving documented substantial, 
sustained, and tangible results. Examples of results are cost savings or cost 
avoidance validated by finance and accounting experts, improved customer 
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satisfaction, reduced cycle time, increased revenues and profits, reduced acci- 
dent rates, improved morale, reduction of critical to customer defects, etc. 
Merely demonstrating the use of Six Sigma tools is not sufficient. Nor is the 
delivery of intermediate “products” such as Pareto diagrams or process maps. 
In addition to passing the [COMPANY] BOK exan, certification requires 


the following: 
1. Acceptable completion of a Black Belt training curriculum approved by 
the Six Sigma organization. 
2. Demonstration of clear and rational thought process. 
a. Ability to analyze a problem following a logical sequence. 
b. Usage of facts and data to guide decisions and action. 
3. Ability to clearly explain Six Sigma and the DMAIC project cycle in lay- 
man’s terms. 
4. Ability to achieve tangible results, e.g., 
a. Completed two or more projects which employed the Six Sigma 
approach (DMAIC or equivalent). 
i. Projects reviewed by appropriate personnel. 
ii. Deliverables accepted by the project sponsor. 
iii. Projects documented in the manner prescribed by the Six 
Sigma organization. 
iv. Projects used the Six Sigma approach and correctly employed 
a significant subset of basic, intermediate, and advanced Six 
Sigma tools and techniques (see page 790 for a listing). 
Ability to perform benefit/cost analysis. 
c. Ability to quantify deliverables in terms meaningful to the organiza- 
tion, e.g., cost, quality, cycle time, safety improvement, etc. 
d. Ability to identify and overcome obstacles to progress. 
e. Ability to work within time, budget, and operational constraints. 
5. Demonstrated ability to explain the tools of Six Sigma to others. 
6. Demonstrated interpersonal and leadership skills necessary to be an 


effective change agent within the organization. 


[COMPANY] Black Belt Certification Board 
The [COMPANY] recommends that each area of effectiveness be rated by at 
least two qualified individuals. Table 19.1 provides guidelines for identifying 
members of the [COMPANY] Black Belt Certification Board. 
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Table 19.1.[ COMPANY] Black Belt Certification Board member selection guide. 


Assessment Subject Area Board Member 


Change agent skills Supervisor, project sponsor(s), Six Sigma 
champion, mentor, process owner, Green 
Belt 


Application of tools and techniques | Black Belt instructor, Master Black Belt, 
[COMPANY] Certified Master Black Belt 


consultant 


Ability to achieve results Project sponsor, process owner, team 
members, Green Belt, Six Sigma champion, 
[COMPANY] Certified Master Black Belt 


consultant 


Effectiveness questionnaire 

The [COMPANY] provides questionnaires to assist [COMPANY] 
Certification Board members with their assessment. It is strongly recom- 
mended that the candidate perform a self-assessment using the [COMPANY] 
questionnaire prior to applying for certification. The candidate should provide 
the Six Sigma champion with a list of potential members of his or her 
Certification Board. 

The effectiveness questionnaire includes a set of assessment questions for 
each subject area. The results of the questionnaires can be summarized and used 
as input into the Six Sigma organization’s certification process. A form for this 
is provided below. The scoring summary sheet summarizes the evaluator’s scores 
by category. Worksheet items scored in the top 3 boxes are considered to be 
acceptable. Particular attention should be directed to any worksheet item scored 
in the lower 4 boxes. Since there are 10 choices for each item, any score below 5 
indicates that the evaluator disagreed with the survey item. Survey items are 
worded in such a way that evaluators should agree with them for qualified Black 
Belt candidates. Disagreement indicates an area for improvement. The scores 
are, of course, not the only input. The [COMPANY] Certification Board must 
also consider any other relevant factors before reaching their decision. 

The Scoring Summary and Assessment Worksheets may be reproduced as 
necessary. 


[COMPANY] Black Belt notebook and oral review 
[COMPANY] Black Belt candidates should provide Certification Board 
members with written documentation of their on the job applications of the 
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Six Sigma approach. These “notebooks” should include all relevant informa- 
tion, including project charters, demonstrations of tool usage, samples of data 
used, excerpts of presentations to sponsors or leaders, team member names, 
project schedules and performance to these schedules, financial and other busi- 
ness results, etc. The notebooks can be distributed to Certification Board mem- 
bers as either soft copies or hard copies, at their discretion. 

Even with the best documentation, it is difficult to assess effectiveness 
properly without providing the candidate the opportunity to present his or 
her work and respond to questions. Six Sigma organizations should require 
that [COMPANY] Black Belt candidates deliver an oral presentation to the 
Certification Board. The oral review will also provide the Certification 
Board with a firsthand demonstration of the candidate’s communication 


skills. 


Change Agent Skills 
Assessment Worksheet 
Black Belt Date of Assessment 
Candidate 
Certification Role 
Board Member 


The candidate effectively identifies and recruits Six Sigma team members 
Strongly Disagree Strongly Agree 
L] L] L] Ls L] L] L] L] L] L] 


The candidate effectively develops Six Sigma team dynamics and motivates parti- 
cipants 


Strongly Disagree Strongly Agree 
L L L L L fe L L L LJ 


The candidate is able to apply conflict resolution techniques 


Strongly Disagree Strongly Agree 
LJ L LJ L L L LJ L L L 
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10. 


11. 


The candidate is able to overcome obstacles to change 
Strongly Disagree Strongly Agree 
L L L LJ L L L L L L 


The candidate utilizes a logical approach to problem solving 


Strongly Disagree Strongly Agree 
L L L L L L L L L L 


The candidate effectively facilitates group discussions and meetings 


Strongly Disagree Strongly Agree 
L L L L L L L L LO L 


The candidate’s presentations are well organized and easy to understand 


Strongly Disagree Strongly Agree 
L L L L L L L L L L 


The candidate identifies and mobilizes sponsors for change 


Strongly Disagree Strongly Agree 
[I L L LJ L L et L I Ea] 


The candidate builds a shared vision of the desired state with champions and 
sponsors 


Strongly Disagree Strongly Agree 
L L L L [3 L L L L L 


The candidate effectively communicates with and obtains support from all levels 
of management 


Strongly Disagree Strongly Agree 
L L L L L L L L L L 


The candidate identifies gaps between as-is and desired performance 


Strongly Disagree Strongly Agree 
L LJ L L L L [ L EE] L 
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12. 


The candidate identifies and obtains support from all key stakeholders 
Strongly Disagree Strongly Agree 
[S| L L L LJ L i L La] L 


Application of Tools and Techniques 
Assessment Worksheet 
Black Belt Date of Assessment 
Candidate 
Certification Role 
Board Member 


The candidate uses an appropriate mix of basic, intermediate and advanced Six 
Sigma tools” 


Strongly Disagree Strongly Agree 
L L L L L L LJ L L L 


The candidate uses the tools of Six Sigma properly 


Strongly Disagree Strongly Agree 
L L L I L L L L L L 


The candidate applies the correct Six Sigma tools at the proper point in the 
project 


Strongly Disagree Strongly Agree 
L L L L L L L L L L 


The candidate asks for help with Six Sigma tools when necessary 


Strongly Disagree Strongly Agree 
L L L L L a L L L L 


The candidate has a working knowledge of word processors, spreadsheets, and 
presentation software 


Strongly Disagree Strongly Agree 
L L LJ L LJ L L L L LJ 


*See page 790 for examples of these tools. 
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The candidate has a working knowledge of a full-featured statistical software 
package 


Strongly Disagree Strongly Agree 
L L LJ L L L L LJ L [ual 


The candidate understands the limitations as well as the strengths of quantitative 
methods 


Strongly Disagree Strongly Agree 
LJ L LJ L L L L L [3] L 


Ability to Achieve Results 
Assessment Worksheet 


Black Belt 
Candidate 


Date of Assessment 


Certification 
Board Member 


The candidate has completed more than one Six Sigma project which produced 
tangible results 


Strongly Disagree Strongly Agree 
L L L L L L L L L L 


The candidate’s projects had an acceptable project charter, including sponsor- 
ship, problem statement, business case, etc. 


Strongly Disagree Strongly Agree 


L L L L L L Lal L L L 
The projects employed the Six Sigma approach (DMAIC or equivalent) 


Strongly Disagree Strongly Agree 
L L L L L L L L L L 


The projects’ deliverables were clearly defined in tangible terms 


Strongly Disagree Strongly Agree 
L L L I L L L L [3] L 
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10. 


11. 


12. 


The projects produced significant improvements to an important business pro- 
cess 


Strongly Disagree Strongly Agree 
L L L L L L L L L L 


The current baseline sigma level was determined using valid data 


Strongly Disagree Strongly Agree 
L L L LJ L L L L L L 


The final sigma level was calculated using valid data and showed improvements 
that were both statistically significant and important to the organization 


Strongly Disagree Strongly Agree 
L L L iS LJ L L L L L 


An acceptable control plan has been implemented to assure that improvements 
are maintained 


Strongly Disagree Strongly Agree 
L L L L L [I L L L [e 


The projects’ financial benefits were validated by experts in accounting or finance 


Strongly Disagree Strongly Agree 
L L L LJ L L L L L L 


Key customers were identified and their critical requirements defined 


Strongly Disagree Strongly Agree 
L L L L L LJ lial L L L 


Project sponsors are satisfied with their project’s deliverables 


Strongly Disagree Strongly Agree 
L L L L L L L L L LJ 


Projects identified and corrected root causes, not symptoms 


Strongly Disagree Strongly Agree 
L L L L L L L L L L 


Appendix Table 19—Black Belt effectiveness certification 787 


13. 


14. 


15. 


16. 


All key stakeholders were kept informed of project status and are aware of final 
outcomes 


Strongly Disagree Strongly Agree 
L L L L L L L L L L 


Projects were completed on time 


Strongly Disagree Strongly Agree 
L L L L La L L L L L 


Projects were completed within budget 


Strongly Disagree Strongly Agree 
L L L L L L L L L L 


Projects were conducted in a manner that minimized disruptions to normal work 


Strongly Disagree Strongly Agree 
L LJ L L L L L L L L 
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Assessment Comments 


Assessment Subject Area Comments 


Change agent skills 


Applications of tools and 
techniques 


Ability to achieve results 
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Scoring Summary 


Evaluator 


Subject Area 


Items scored 4 
or less 


% in top 3 
boxes 


Comment 


Change agent 
skills 
Application of 
tools and 
techniques 


Ability to achieve 
results 


Change agent 
skills 


Application of 
tools and 
techniques 


Ability to achieve 
results 

Change agent 
skills 
Application of 
tools and 
techniques 
Ability to achieve 
results 


Change agent 
skills 


Application of 
tools and 
techniques 


Ability to achieve 
results 


Change agent 
skills 


Application of 
tools and 
techniques 


Ability to achieve 
results 
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Examples of Six Sigma tools and analytical concepts 


Basic Intermediate Advanced 
DMAIC Control charts for Exponentially 
SIPOC measurements weighted moving 
DPMO Control charts for average control 
Computer skills attributes charts 
Scales of Process capability Short run SPC 
measurement Yield analysis (eg., Design and analysis 
Pareto analysis first pass yield, of experiments 
Process mapping, rolled throughput ANOVA, 
flowcharts yield) MANOVA and 
Check sheets Measurement error other general linear 
Cause-and-effect analysis (gage R&R) models 
diagrams Correlation analysis Multiple linear 
Scatter plots Simple linear regression 
Run charts regression Basic reliability 
Histograms Chi-square analysis 
Ogives Type land Type II Design for Six 
Descriptive statistics errors Sigma 
(e.g., mean, standard Confidence interval Simulation and 
deviation, skewness) interpretation modeling 
Enumerative vs. Hypothesis tests Statistical 
analytic statistics Normality tolerancing 


Stem-and-leaf, 
boxplots 

Basic probability 
concepts 

Discrete probability 
distributions 
(binomial, Poisson, 
hypergeometric) 
Continuous 
probability 
distributions 
(normal, 
exponential, etc.) 
7M tools 

FMEA 

Sampling 

CTx identification 


assessment and 
transformations 
Z transformations 
Process sigma 
calculations 


Response surface 
methods 

Robust design 
concepts 

Design, validation 
and analysis of 
customer surveys 
Logistic regression 
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Green Belt Effectiveness 
Certification 


Green Belt Certification Recommendation 

Name (as it will appear on the certificate) 
Payroll Number 

Org Code Date 


We the undersigned, on behalf of [COMPANY] certify the above named individual as a 
Six Sigma Green Belt. 


Printed or typed Board Date 
member name Signature Signed 
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GREEN BELT SKILL SET CERTIFICATION PROCESS 
Introduction 


This document describes the process and provides the minimum criteria for 
certifying an individual as a Six Sigma Green Belt. Certification involves recog- 
nition by [COMPANY], and should not be construed as a professional license. 


GREEN BELT EFFECTIVENESS CERTIFICATION 
CRITERIA 


To become a Certified Green Belt, the candidate must demonstrate: 

1. Ability to lead organizational change as demonstrated by the candidate’s 
leadership, teamwork, project management, communication and tech- 
nical skills. 

2. Ability to achieve tangible results that have a significant impact by apply- 
ing the Six Sigma approach 

This section describes the criteria for certifying that a Green Belt candidate is 

“effective” in applying the Six Sigma approach. Effectiveness means that the 
candidate has demonstrated the ability to lead the change process by success- 
fully applying Six Sigma methodologies on a significant project. Success is 
demonstrated by achieving documented substantial, tangible and sustained 
results. Examples of results are cost savings or cost avoidance validated by 
finance and accounting experts, improved customer satisfaction, reduced cycle 
time, increased revenues and profits, reduced accident rates, improved 
employee morale, reduction of critical to customer defects, etc. Merely demon- 
strating the use of Six Sigma tools is mot sufficient. Nor is the delivery of inter- 
mediate “products” such as Pareto diagrams or process maps. 

Certification as a Green Belt requires the following: 

1. Acceptable completion of a Green Belt training curriculum approved by 
the Six Sigma organization. 

2. Demonstration of clear and rational thought process. 

a. Ability to analyze a problem following a logical sequence. 
b. Usage of facts and data to guide decisions and action. 

3. Ability to clearly explain Six Sigma and the DMAIC project cycle in lay- 
man’s terms. 

4. Ability to achieve tangible results, e.g., 

a. Completed one or more projects that employed the Six Sigma 
approach (DMAIC or equivalent). 
i. Projects reviewed by appropriate personnel. 
ii. Deliverables accepted by the project sponsor. 
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c. 


d. 


e. 


iii, Projects documented in a Green Belt notebook arranged in 
the DMAIC or equivalent format. 

iv. Projects used the Six Sigma approach and correctly employed 
a significant subset of basic tools and at least some inter- 
mediate Six Sigma tools and techniques (see page 803) for a 
listing). 

Ability to perform benefit/cost analysis. 

Ability to quantify deliverables in terms meaningful to the organiza- 
tion, e.g., cost, quality, cycle time, safety improvement, etc. 

Ability to identify and overcome obstacles to progress. 

Ability to work within time, budget, and operational constraints. 


5. Demonstrated ability to explain the tools of Six Sigma to others in ordin- 
ary language. 

6. Demonstrated interpersonal and leadership skills necessary to be an 
effective change agent within the organization. 


Green Belt Certification Board 


Effectiveness must be determined by qualified individuals familiar with the 


candidate’s 


performance in the given effectiveness area. Table 20.1 provides 


guidelines for identifying prospective members of the Green Belt Certification 


Board. It is 


the Green Belt’s responsibility to assist with the selection of their 


Certification Board. 


Table 20.1. Green Belt Certification Board member selection guide. 

Assessment Subject Area Board Member 

Change agent skills Supervisor, project sponsor(s), Six Sigma 
champion, mentor, process owner, Black 
Belt 

Application of tools and techniques Green Belt instructor, Master Black Belt, 
qualified Certified Master Black Belt Six 
Sigma consultant 

Ability to achieve results Project sponsor, process owner, team 


members, Green Belt, Six Sigma champion, 
Certified Master Black Belt, qualified Six 


Sigma consultant 
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Effectiveness questionnaire 


It is strongly recommended that the candidate perform a self-assessment 
prior to applying for certification. 

Certification Board members are encouraged to use the following question- 
naires to assist them with their assessment. The candidate should provide the 
Six Sigma champion with a list of potential members of his or her 
Certification Board. When questionnaires are completed by someone other 
than a Certification Board member, they should be sent directly to a 
Certification Board member. 


SCORING GUIDELINES 


The effectiveness questionnaire includes a set of assessment questions for 
each subject area. The results of the questionnaires can be summarized and 
used as input into the certification process. A form for this is provided below. 
The scoring summary sheet summarizes the evaluator’s scores by category. 
Worksheet items scored in the top 3 boxes are considered to be acceptable. 
Particular attention should be directed to any worksheet item scored in the 
lower 4 boxes. Since there are 10 choices for each item, any score below 5 indi- 
cates that the evaluator disagreed with the survey item. Survey items are worded 
in such a way that evaluators should agree with them for qualified Green Belt 
candidates; i.e. higher scores are always better. Disagreement (low scores) in a 
few areas does not necessarily disqualify a candidate for certification. 
However, it indicates areas which need improvement and it is recommended 
that certification be granted only if the candidate agrees to a program for addres- 
sing these areas. The scores are, of course, not the only input. Ultimately each 
Certification Board member must exercise his or her own judgment and con- 
sider any other relevant factors before reaching a decision. 

The Scoring Summary and Assessment Worksheets may be reproduced as 
necessary. 


Green Belt notebook 


Green Belt candidates should provide Certification Board members with 
written documentation of their on the job applications of the Six Sigma 
approach. These “Green Belt notebooks” should include all relevant informa- 
tion, including project charters, demonstrations of tool usage, samples of data 
used, excerpts of presentations to sponsors or leaders, team member names, 
project schedules and performance to these schedules, financial and other busi- 
ness results, etc. The notebooks can be distributed to Certification Board mem- 
bers as either soft copies or hard copies, at the candidate’s discretion. 
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Change Agent Skills 
Assessment Worksheet 
Green Belt Date of 
Candidate Assessment 
Certification Role 
Board Member 


The candidate effectively identifies and recruits Six Sigma team members 
Strongly Disagree Strongly Agree 
L] L] Le L] LJ L] L] L] L] L] 


The candidate effectively develops Six Sigma team dynamics and motivates parti- 
cipants 


Strongly Disagree Strongly Agree 
L L L L L L L L L L 


The candidate is able to apply conflict resolution techniques 
Strongly Disagree Strongly Agree 
L L L L L L L L L L 


The candidate is able to overcome obstacles to change 
Strongly Disagree Strongly Agree 
L L L L L L L LJ L L 


The candidate utilizes a logical approach to problem solving 
Strongly Disagree Strongly Agree 
L L L L L L LJ L Ed L 


The candidate effectively facilitates group discussions and meetings 
Strongly Disagree Strongly Agree 
L LJ L L L L L LJ L L 
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7 The candidate’s presentations are well organized and easy to understand 
Strongly Disagree Strongly Agree 
L L L LJ L L iat L La] L 


8. The candidate identifies and mobilizes sponsors for change 


Strongly Disagree Strongly Agree 
L LJ L L LJ LJ le L L L 


9. The candidate builds a shared vision of the desired state with champions and 
sponsors 


Strongly Disagree Strongly Agree 
L L L L L L L L L L 


10. The candidate identifies gaps between as-is and desired performance 
Strongly Disagree Strongly Agree 
L L LO L L L L L L L 


11. The candidate identifies all key stakeholders and obtains support for the project 


Strongly Disagree Strongly Agree 
L L L L LJ L L L L L 
Application of Tools and Techniques 
Assessment Worksheet 
Green Belt Date of Assessment 
Candidate 
Certification Role 
Board Member 
1. The candidate uses an appropriate mix of basic and intermediate Six Sigma tools* 
Strongly Disagree Strongly Agree 


(a L] L] L] L] L] as L] L] L] 


* See page 803 for a partial listing of these tools. 
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The candidate uses the tools of Six Sigma properly 
Strongly Disagree Strongly Agree 
L] L] L] cal L] aa Lil L] L] L] 


The candidate applies the correct Six Sigma tools at the proper point in the project 
Strongly Disagree Strongly Agree 
L LJ L L L L L LJ L L 


The candidate asks for help with Six Sigma tools when necessary 
Strongly Disagree Strongly Agree 
L L L L L [I I L | L 


The candidate can clearly explain all of the Six Sigma tools used on their projects 
in ordinary language. Note: candidates are not required to be able to perform all 
of the analyses without assistance, but they are required to understand basic or 
intermediate tools used for their projects. 


Strongly Disagree Strongly Agree 
L L L L L L L L L L 


The candidate understands the limitations as well as the strengths of quantitative 
methods 


Strongly Disagree Strongly Agree 
L L L L L L L L L L 


Ability to Achieve Results 
Assessment Worksheet 
Green Belt Date of 
Candidate Assessment 
Certification Role 
Board Member 
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The candidate has successfully completed at least one Six Sigma project which 
produced tangible results 


Strongly Disagree Strongly Agree 
L L L L L L L L L L 


The candidate’s project(s) had an acceptable project charter, including sponsor- 
ship, problem statement, business case, etc. 


Strongly Disagree Strongly Agree 
L L L L L L L L L L 


The projects employed the Six Sigma approach (DMAIC or equivalent) 
Strongly Disagree Strongly Agree 
L L LJ L L L L L L L 


The projects’ deliverables were clearly defined in tangible terms 
Strongly Disagree Strongly Agree 
L L L L L L L L L L 


The projects produced significant improvements to an important business 
process 


Strongly Disagree Strongly Agree 
L L L L L L L LJ L L 


The baseline performance level was determined using valid data 
Strongly Disagree Strongly Agree 
L] L] L] L] L] L] L] EI L] L] 


The final performance level was calculated using valid data and showed improve- 
ments that were both statistically significant and important to the organization 


Strongly Disagree Strongly Agree 
L L L L L L L L L L 
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10. 


11. 


12. 


13. 


14. 


An acceptable control plan has been implemented to assure that improvements 
are maintained 


Strongly Disagree Strongly Agree 
L L L L la L L L LJ L 


The projects’ financial benefits were validated by experts in accounting or finance 
Strongly Disagree Strongly Agree 
[a] L L L L L L L L L 


Key customers were identified and their critical requirements defined 
Strongly Disagree Strongly Agree 
L] L] L] L] L] L] L] L] L] L] 


Project sponsors are satisfied with their project’s deliverables 
Strongly Disagree Strongly Agree 
L L L L L L L L Ed L 


Projects identified and corrected root causes, not symptoms 
Strongly Disagree Strongly Agree 
L L L L L L L L L L 


All key stakeholders were kept informed of project status and are aware of final 
outcomes 


Strongly Disagree Strongly Agree 
L L L L al L [es L LO L 


Projects were completed on time 
Strongly Disagree Strongly Agree 
L LJ L L La L L L L L 
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15. Projects were completed within budget 
Strongly Disagree Strongly Agree 
L] L] L] L] L] L] a L] Li] ma 
16. Projects were conducted in a manner that minimized disruptions to normal work 


Strongly Disagree Strongly Agree 
L L L L L L L L L L 
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Assessment Comments 


Assessment Subject Area Comments 


Change agent skills 


Application of tools and 
techniques 


Ability to achieve results 
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Scoring Summary 


Items scored 4 % in top 3 
Evaluator Subject Area or less boxes Comment 


Change agent 
skills 
Application of 
tools and 
techniques 


Ability to achieve 
results 


Change agent 
skills 


Application of 
tools and 
techniques 


Ability to achieve 
results 

Change agent 
skills 
Application of 
tools and 
techniques 
Ability to achieve 
results 


Change agent 
skills 


Application of 
tools and 
techniques 


Ability to achieve 
results 


Change agent 
skills 


Application of 
tools and 
techniques 


Ability to 
achieve results 
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Examples of Six Sigma Tools and Analytical Concepts 


Basic 


Intermediate 


DMAIC 

SIPOC 

DPMO 

Computer skills 

Scales of measurement 

Pareto analysis 

Process mapping, flowcharts 
Check sheets 

Cause-and-effect diagrams 

Scatter plots 

Run charts 

Histograms 

Ogives 

Descriptive statistics (eg., mean, 
standard deviation, skewness) 
Enumerative vs. analytic statistics 
Stem-and-leaf, boxplots 

Basic probability concepts 
Discrete probability distributions 
(binomial, Poisson, hypergeometric) 
Continuous probability distributions 
(normal, exponential, etc.) 

7M tools 

FMEA 

Sampling 

CT x identification 


Control charts for measurements 
Control charts for attributes 
Process capability 


Yield analysis (e.g,, first pass yield, rolled 


throughput yield) 

Measurement error analysis (gage R&R) 
Correlation analysis 

Simple linear regression 
Chi-square 

Type Land Type II errors 
Confidence interval interpretation 
Hypothesis tests 

Normality assessment and 
transformations 

Z transformations 

Process sigma calculations 
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AHP Using Microsoft Excel’™ 


The analytic hierarchical process (AHP) is a powerful technique for decision 
making. It is also quite elaborate and if you wish to obtain exact results you 
will probably want to acquire specialized software, such as Expert Choice 2000 
(www.expertchoice.com). However, if all you need is a good approximation, 
and if you are willing to forgo some of the bells and whistles, you can use a 
spreadsheet to perform the analysis. To demonstrate this, we will use 
Microsoft Excel to repeat the analysis we performed in Chapter 3. 


Example 
In Chapter 3 we analyzed the high-level requirements for a software develop- 
ment process and obtained this matrix of pairwise comparisons from our custo- 
mers. 


Easy to Easy to | Internet Easy to 
learn use connectivity manage 


Easy to learn 4.0 1.0 1.0 
Easy to use quickly after I've learned it 5.0 ; 4.0 


Internet connectivity 3.0 


Works well with other software I own 3.0 


Easy to maintain Incon: 0.05 


The meaning of the numbers is described in Chapter 3. The Excel equivalent 


of this is 

A B C OD EE F 
1 Attribute Pe Be “Ge De ie 
2 A-Easy to learn 0.00 4.00 1.00 3.00 1.00 
3 B-Easy to use 0.25 0.00 0.20 0.33 0.25 
4 C-Connectivity 1.00 5.00 0.00 3.00 3.00 
5 D-Compatible 0.33 3.00 0.33 0.00 0.33 
6 E-Easytomaintain 1.00 4.00 0.33 3.00 0.00 
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Note that the paler numbers in the original matrix have become reciprocals, 
e.g. the pale 5.0 is now 0.20, or 1/5. Also note that the numbers on the diagonal 
are zeros, ie., the comparison of an attribute with itself has no meaning. 
Finally, the numbers below the diagonals are the reciprocals of the correspond- 
ing comparison above the diagonal. For example, the cell C2 has a 4.00, indicat- 
ing that attribute A is preferred over attribute B; so the cell B3 must contain 
+ = 0.25 to show the same thing. 

To calculate the weight for each item, we must obtain the grand total for the 


entire matrix, then divide the row totals by the grand total. This is shown below: 


A B C D E F 

1 Attribute A B CC D_~ E Total Weight 
2 A-Easy to learn 0.00 4.00 1.00 3.00 1.00 9.00 26.2% 
3 B-Easy to use 0.25 0.00 0.20 0.33 0.25 1.03 3.0% 
4 C-Connectivity 1.00 5.00 0.00 3.00 3.00 12.00 34.9% 
5 D-Compatible 0.33 3.00 0.33 0.00 0.33 4.00 11.6% 
6 E-Easytomaintain 1.00 4.00 0.33 3.00 0.00 8.33 24.2% 
7 Grand total 34.37 


These results are shown in the figure below. 
Category Importance Weights 
34.9% 


30% 
26.2% 24.2% 


Weight 
8 
aS 


15% 11.6% 


5% 3.0% 


A-Easy to learn B-Easy to use C-Connectivity D-Compatible E-Easy to maintain 


Compare these weights to those obtained by the exact analysis obtained 
using Expert Choice 2000. 


Exact | Spreadsheet 


Category Weight] Weight 
Easy to use quickly after I’ve learned it 5.4% 3.0% 
Internet connectivity 35.8% 34.9% 
Works well with other software I own 10.5% 11.6% 
Easy to maintain 21.8% 24.2% 


The conclusions are essentially the same for both analyses. 
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Notes: As Six Sigma is the subject of this book, all references in the index concern Six Sigma unless otherwise specified: readers are 
advised to seek more specific entries. Abbreviations used in subentries are to be found within the body of the index. 


ability assessments, 151 
abstract ideas, 154 
Acceptable Quality Level (AQL), 716-717 
definition, 724, 728 
accuracy 
analysis, 357-360 
between appraisers, 359, 360 
within appraisers, 358, 360 
attribute measurement concept, 347 
calculation, 355 
definition, 280 
stability of, 355 
active listening 
facilitators, 162 
self-managed teams, 171 
activity network diagrams, 276 
actual quality, 5 
adjusted R square, 511 
advocates, 14 
affinity diagrams 
7M tools, 264-265, 266 
CTQ importance, 669 
structured decision making, 142 
aggressors, 177 
AHP see Analytical Hierarchical Process (AHP) 
o errors, type I errors 
alternative hypotheses, 288, 726 
analysis of variance (ANOVA), 493 
definition, 724 
one-factor, 614-616 
power functions, 761-769 
regression analysis, 511 
R&R analysis, 338, 339-340 
two-way 
with replicates, 618-621 
without replicates, 617-618 
Analytical Hierarchical Process (AHP), 270 
customer importance measurements, 675 
Microsoft Excel™ example, 804-805 
structured decision making, 143 
Analyze Phase in DMADV see DMADV 
ANOVA see analysis of variance (ANOVA) 
AOQ, 724 


AOQL see Average Outgoing Quality Limit (AOQL) 


application example (of Six Sigma), 4-5 
apportionment, reliability analysis, 573-573 
appraisal costs see costs 

Approved Parts Lists, 656, 657 

Approved Process Lists, 656, 657 


AQL see Acceptable Quality Level (AQL) 
arrow diagrams 
7M tools, 276 
example, 550 
project management, 536 
“as-is” process maps, 253 
assessments 
ability, 151 
attitude, 151 
change management, 16 
customer satisfaction, 192 
needs analysis, 151 
risk see risk assessment 
skills, 151 
assignable causes of variation, 322 
definition, 724 
assumptions 
definitions, 290-291 
testing, 490-496 
attitude assessments, 151 
attribute control charts see control charts 
attribute data, 346 
definition, 279 
attribute measurement error analysis, 346-360 
approaches, 350, 351-352 
concepts, 346-360 
example, 350, 352 
individual inspector accuracy, 350, 352 
audit criteria, 650 
automated manufacturing, EWMA, 453-454 
availability, 572 
average occurences-per-unit control charts (w charts) see control 
charts 
Average Outgoing Quality (AOQ), 724 
Average Outgoing Quality Limit (AOQL) 
definition, 724 
y factors, 754 
averages and standard deviation (sigma) control charts see 
control charts 
averages control charts see control charts 


bs life, 572 
bj life, 572 
background variables, 609 
balanced scorecards, 33, 61-74 
cause-and-effect measurement, 62-64 
core competencies see core competencies 
customer perceived value see customer perceived value 
customer perspective see customer scorecards 
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financial perspective, 70-71 
information systems, 64-65 
innovation and learning perspective, 69-70 
mode of action, 62 
basic quality, 119 
batch-and-queue, 713-714 
behaviors, training evaluation, 163 
“bell curve,” 300 
benchmarking, 91—96, 240 
benefits, 96 
dangers, 96 
failure, 94-96 
initiation, 92-94 
process, 92 
sources, 93—94 
benchmarks, 73 
definition, 68 
benefit—cost analysis, 24-25, 212 
problems, 190 
project evaluation, 189-190 
benefits , 10-13 
indirect, 10-11 
B errors see type II errors 
bias, 328-329 
attribute measurement concept, 347 
calculation, 355 
definition, 280 
illustration, 281, 329 
stability of, 355 
binary regressions see logistic regressions 
binomial distributions 
example, 294 
ordinal scales, 279 
Black Belts see also change agents; Green Belts; Master Black 
Belts 
commitment, 47 
computer literacy, 29 
definition, 8 
effectiveness certification, 778-790 
implementation phase, 21, 28-29 
information systems, 65 
organizational roles/responsibilities, 37-38, 41 
Process Enterprise implementation, 131 
project evaluation, 190-191, 196 
project tracking, 209 
reintegration into organization, 47 
reporting, 37-38 
selection criteria, 47, 73-74 
selection process, 38, 43—47 
success factors, 45—46 
training, 28, 155-158 
blockers, 177 
blocks, 608 
bootstrapping, 317-318 
“bosses, multiple,” 566, 567 
boxplots, 384-385, 386 
BPE see Business Process Executive (BPE) 
brainstorming, 240 
process control planning, 652 
break-even points, 213 
bucket brigade algorithms, 247 
budgets see also financial analysis 


direct labor, 558 

linked to customer demands, 140-149 
project, 558 

project management, 536, 558-560 
projects, 558 


purchased items, 558 
reports 


analysis, 559-560 
project management, 558-559 
reviews, 543 
revision, 651 
strategic training plan, 152 
support service, 558 
business intelligence, data mining, 78 
business processes, implementation phase, 21 
Business Process Executive (BPE) 
Coordination Plan, 132 
definition, 129 
Process Enterprise implementation, 131-132 
business process reengineering, 49 
business project mapping, project selection, 188 


candidate metrics, 67 
canonical design, 640 
capability indices, 472-475 see also individual indices 
case studies, 103 
category importance weights see importance weights 
cause-and-effect, 8 
check sheets, 259 
diagrams, 240, 261-264 
production process class, 264 
measurements, 62—64 
statistics, 490-533 
c charts see control charts 
censored tests, 572 
central limit theorem, 319, 320 
central repository, data warehousing, 75 
certification boards, 40 
champions, 28 
project, 253 
chance causes of variation, 322 
definition, 725 
change 
imperative, 11-13 
incorporation, 12 
management, 13-14, 14-15 
networks, 19 
change agents, 13—20 see also Black Belts; Green Belts; Master 
Black Belts 
change management, 14-15 
coaching activities, 18 
compensation/retention, 54-55 
goals, 15-16 
mechanisms, 16-18 
monitor activities, 18 
position creation/selection, 44—45 
project tracking, 209 
required skills, 160 
role, 14 
“soft skills” training, 158-161 
support network, 18 
check sheets, 255-259 
cause and effect, 259 
confirmation, 255 
defect, 257-258 
location, 258 
stratified, 257, 258 
process, 256, 257 
Chi-square distribution, 306-308, 514-516 
example, 515-516, 529 
inverse, 308 
nominal logistic regression vs., 528 
principle, 514 
tables, 735-737 
CIT see Critical Incident Technique (CIT) 
CLOSEDMITTS (Lean), 708, 709 
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Cy capability index, 472, 474 
example, 475-476 
coaching 
change agent activities, 18 
definition, 160 
code value charts, 431 
coefficient of correlation, 725 
coefficient of determination, 725 
coefficient of multiple correlation, 725 
coefficient of variation, 725 
“common bosses,” 566, 567 
common cause charts, EWMA, 455-458 
common causes of variation, 322 
communication, 12—13, 31, 33-35 
change agents, 160 
cross-functional collaboration, 566-567 
customer-driven organizations, 100-101, 102-116 
with customers, 102-116 
with employees, 102-116 
facilitators, 161, 182 
implementation phase, 21 
leaders, 36, 153-154 
middle management, 36 
multimedia, 34 
presentation preparation, 161 
project management, 555 
requirements, 35, 36 
responsibilities, 35 
self-managed teams, 171 
skills, 47 
vision, 154 
comparison matrices, 146 
compensation 
change agents, 54-55 
training, 160-161 
customer-driven organizations, 102 
non-financial, 54 
teams, 184-186 
training reinforcement, 165 
complaint systems 
communication, 114 
handling, 118-119 
completion time, project evaluation, 197 
composite design phase see empirical model building 
compounding periods 
continuous, 215 
definition, 214-215 
non-annual, 215 
compromisers, 176 
computer proficiency 
Black Belts, 29, 47 
Green Belts, 49 
confessors, 177 
confidence intervals, 310 
confidence limits, 312, 602, 725 
confirmation check sheets, 255 
conflict resolution, 171-178 
definition, 160 
leader training, 154-155 
constraint management, 715 
consumer’s risk (B), 725 
contingency plans, 565 
continuous compounding periods, 215 
continuous data see data, continuous 
continuous improvement initiatives, 69 
continuous process improvement, 49 
implementation phase, 21 
control, 321 


limits, 602 
maintenance see process control planning (PCP) 
plans, 537 

in process capability analysis, 469 


control charts, 393-453 see also statistical process control (SPC) 


attribute, 406-418 
process capability analysis, 471 
process control planning, 654 
average occurences-per-unit (u charts), 411-416 
analysis, 413 
control limit equations, 412-413, 758 
example, 413-416 
stabilized, 446, 447 
averages and ranges, 393-398 
control limit equations, 394-395 
examples, 395-398 
subgroup equations, 394 
averages and standard deviation (sigma), 398—401 
control limit equations, 398-399 
examples, 399-401, 402 
subgroup equations, 398 
constants, 755-756 
decision tree, 419 
defective count (np charts), 409-411 
control limit equations, 410, 757 
examples, 410-411, 412 
stabilized, 446, 447 
demerit, 449-452 
EWMA, 458-464 
individual measurements (X charts), 401-405 
calculations, 403 
control limit equations, 403, 758 
examples, 403—406 
factors, 770-771 
interpretation, 420-426 
occurences-per-unit (c charts), 416-418 
analysis, 417 
control limit equations, 416-417, 758 
example, 417-418, 419 
stabilized, 446, 447 
patterns 
cycles, 421-423, 422 
discrete data, 423 
drift, 421, 422 
freaks, 420-421, 421 
mixtures, 425, 426 
out-of-control, 427 
planned changes, 424 
repeating patterns, 423-424 
suspected differences, 425 
process control planning, 654 
proportion defective (p charts), 406-409 
analysis, 406 
control limit equations, 406, 757 
examples, 407—408, 409 
pointers, 408—409 
stabilized, 446, 447 
purpose, 424 
rational subgroups, 394 
sampling, 420 
R charts 
control limit equations, 758 
factors, 770-771 
selection, 418-419 
stabilized, 432, 439-443, 445-449 
variable, 393-405 
process capability analysis, 471-472 
X-bar charts 
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control limit equations, 758 
factors, 770-771 
zones, 427 
control limit equations 
averages and ranges control charts, 394-395 
averages and standard deviation control charts, 398-399 
c charts, 416-417, 758 
individual measurements control charts (X charts), 403, 758 
np charts, 410, 757 
proportion defective control charts (p charts), 406, 757 
R charts, 758 
u charts, 412-413, 758 
X-bar charts, 758 
coordinators, 175 
core competencies, 72, 73 
customer perceived value vs., 69 
identification, 68 
core teams see teams 
correlation analyses, 512-514 see also regression analysis 
lurking variables, 513 
Pearson’s product-moment, 513 
correlation coefficients, 725 
cost control plans, 537 
costs, 212 see also financial analysis 
appraisal, 220 
examples, 227 
audits, 558-559 
direct, 555 
external failure, 220 
examples, 228 
failure, 220 
fixed, 212 
indirect, 554 
internal failure, 220 
examples, 227-228 
prevention, 220 
examples, 226 
quality see quality costs 
reports, 558 
total, 555 
variable, 212 
waste, 224 
C, capability index, 472, 473-474 
example, 475-476 
Cox capability index, 473, 475 
example, 475-476 
CPM see critical path method (CPM) 
Com capability index, 473 
crash schedules, 553 
Cr capability index, 472, 474 
example, 475-476 
creative thinking, 11 
critical chain project portfolio management, 206-208 
critical incidents, 110 
Critical Incident Technique (CIT) 
survey question development, 104 
surveys, 108 
critical path method (CPM), 273 
calculation, 549 
example, 550, 551 
project management, 545, 547-552 
cross-functional process mapping, 253-254 
CTC projects, 204 
CTQ see Quality Improvement (CTQ) 
CTS projects, 204 
CTx information, 203-205 
cumulative distributions, 292 
customer-driven organizations, 97-149 


communications, 100—102, 102-116 
directors role, 101 
elements, 98—102 
employee rewards, 102 
major elements, 97-102 
project selection, 188 
results measurement, 101—102 
traditional organizations vs., 99-100 
union role, 101 
customer impact score, 148-149 
customers 
attitudes, organizational comparisons, 99 
audits, 543 
demands 
linked to budget, 140-149 
models, 144 
demands of 
change management, 13-14 
expectations, 119-121 
feedback, 115-116 
panels, 114 
perceived value, 67 
core competencies vs., 69 
project selection, 188 
pull, 713-716 
retention, 116-119 
loyalty-based management™, 117 
net present value, 117 
satisfaction, 192 
strategic training plan, 152 
survey, 773-776 
value, negative, 224 
customer scorecards, 65-67 
customer value projects, 188 
cycles, control charts, 421-423, 422 
cycle time reduction, project evaluation, 193-194 


d . values, 759-760 
dashboard metrics, 62-63 
dashboards 
data types, 80-81 
definition, 62 
design, 79-89 
finance, 71 
innovation and learning measurement, 69—70 
planning, 79-80 
qualities, 80 
scale data, 81-84 
defectives over time, 83 
distribution, 82-83 
examples, 81-83 
interpretation, 84 
layout, 82 
outliers/tail perspectives, 83 
process scale tendency, 82 
data see also information systems; measurements 
classification, 109-110 
collection, 109 
continuous see data, continuous 
discrete see data, discrete 
exploration, data mining, 78 
interpretation, 110-111 
nominal see data, nominal 
ordinal see data, ordinal 
preparation, data mining, 77—78 
presentation tools, 361-385 
quality, in DMADV, 670 
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data (continued) 
range, in DMADV, 670 
scoring/labeling, 78 
selection, in data mining, 77 
space, 505-506 
storage, 209 
support, 7-8 
transformation, 495 
transport/cleansing, 15 
warehousing, 74-75, 76 
data, continuous, 289, 490-492 
discrete data conversion from, 491 
discrete data conversion to, 491-492 
data, discrete, 288, 490-492 
continuous data, conversion from, 491—492 
continuous data, conversion to, 491 
control charts, 423 
definition, 289 
data marts, 75 
data mining, 76-79, 240 
alarm monitoring, 78 
business intelligence, 78 
decision support systems, 78 
definition, 76 
exploration, 78 
goal definition, 77 
and on-line analytic processing, 79 
patterns, 78-79 
preparation, 77—78 
scoring/labeling, 78 
selection, 77 
validity monitoring, 78-79 
data, nominal 
dashboards, 87-89 
defectives over time, 87-88 
example, 87-89 
interpretation, 89 
issue resolution, 88 
layout, 87 
Pareto analysis, 89 
process Failure Mode and Effects Analysis, 89 
definition, 81 
data, ordinal 
dashboards, 84-86 
defectives over time, 85 
example, 84—86, 86 
interpretation, 86 
layout, 85 
outliers/tail perspective, 85 
process central tendency, 84 
ratings distribution, 84-85 
definition, 81 
decision making, organizational comparisons, 100 
decision making, structured, 140-145 
Decision Rights Matrix, 130 
Process Enterprise implementation, 132 
decision support systems, data mining, 78 
defect check sheets, 257-258 
defective count control charts (np charts) see control charts 
defectives, 725 
defectives over time 
nominal data dashboards, 87-88 
ordinal data dashboards, 85 
scale data dashboards, 83 
defect location check sheets, 258 
defects, definition, 725 
Define-Measure-Analyze-Design-Verify see DMADV 
Define-Measure-Analyze-Improve-Control see DMAIC 
Define Phase in DMADV see DMADV 


definition (of Six Sigma), 3-4 
deliverability, project evaluation, 196 
demerit control charts, 449-452 
denominator management, 90 
dependent variables, 496, 504 
definition, 609 
Deployment Manuals, 31, 33 
deployment timelines, 24-25 
derating, 572 
design-based inference, 288 
design for Six Sigma (DFSS), 665-704 see also DMADV 
preliminary steps, 665-666 
tasks/resources, 666 
design of experiments (DOE), 607-648 
artificial neural networks, 644-648 
characteristics, 610-611 
data mining, 644-648 
empirical model building see empirical model building 
full/fractional factorial, 621-624 
analysis, 621-623 
definition, 621 
one-factor ANOVA, 614-616 
power and sample size, 610 
sequential learning see empirical model building 
software applications, 616-624 
terminology, 608-609 
traditional approach vs. factorial experiments, 607-608 
two-way ANOVA 
with replicates, 618-621 
without replicates, 617-618 
types, 611-616 
completely randomized, 611-612 
fixed-effects model, 611 
latin-square, 613 
mixed model, 611 
random-effects model, 611 
randomized block, 612 
virtual process mapping, 644-648 
Design Phase in DMADV see DMADV 
design review, risk assessment, 591 
detailed plan work breakdown structure, 541-542 
detectability (DET), 598-599 
determination, coefficient of, 725 
DFSS see design for Six Sigma (DFSS) 
differentiators, 72, 73 
deploying to operations, 136-138 
goal setting, 91 
QED matrix, 137 
direct costs, 555 
direct labor budgets, project management, 558 
directors 
customer-driven organization, 101 
organizational roles/responsibilities, 39-40 
discrete data see data, discrete 
discrimination, measurement systems analysis, 325-326 
“diseases,” Pareto analysis, 198-199 
distributions, 291-310 see also individual distributions 
cumulative, 292 
examples, 468 
frequency, 292 
location, 319 
sampling, 292-293 
scale data dashboards, 82—83 
shape, 319 
spread, 319 
in statistical process control, 318-319 
DMADV, 239-242 see also design for Six Sigma (DFSS); 
learning models 
Analyze, 671-681 
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category importance weights, 676-677, 679 
CTQ linking, 671, 678-681 
Customer Demand Model, 672 
customer demands, 674-681 
definition, 666 
design decisions, 674-681 
global importance weights, 678, 679, 680 
Pugh concept selection method, 681 
SIPOC tracing, 673 
subcategory importance weights, 677, 679 
tasks/responsibilities, 671 
Define, 667-670 
Analytical Hierarchical Process, 668-670 
CTQ identification, 667 
CTQ importance, 668-670 
definition, 666 
“delighter” identification, 667-668 
Design, 682-703 
backlog, 692-693 
cross-references, 703 
CTQ performance prediction, 682-685 
management constraints, 692 
model development, 689-691 
process simulation, 685-699 
process simulation example, 688—689 
process simulation tools, 686-688 
virtual design of experiments, 699-703 
DMAIC vs., 242 
FMEA process, 597 
framework for DMSS, 666 
Measure, 670—671 
definition, 666 
plans, 671 
overview, 241 
Verify, 703-704 
cross-references, 704 
definition, 666 
full-scale transition, 704 
pilot run, 704 
tasks/responsibilities, 703 
DMAIC see also learning models 
application, 239 
definition, 4, 237-239 
definitions, 238 
DMADV vs., 242 
FMEA process, 597 
introduction, 237-251 
overview, 238 
project evaluation, 197 
project management, 545, 546-547 
tools used, 240 
DOE see design of experiments (DOE) 
dominators, 174, 177 
double sampling, 726 
drift, in control charts, 421, 422 
“drill-down” capabilities, 64, 65 
Durbin—Watson Test Bounds, 750-753 


earnings before interest and taxes (EBIT), 213 
EBIT, 213 
EDA see exploratory data analysis (EDA) 
education 

Black Belts, 47 

change management, 16 

definition, 150 

Green Belts, 49 
elaborators, 175 
empirical control equation, automated manufacturing process 

control, 466 


empirical model building, 624-644 see also factorial 
experiments; knowledge discovery 
Phase 0 (knowledge discovery) 
definition, 624-625 
example, 626-627 
Phase I (screening experiment) 
definition, 625 
example, 627-631 
Phase II (steepest ascent) 
definition, 625 
example, 631-633 
Phase III (factorial experiment) 
definition, 625 
example, 633-636 
Phase IV (composite design) 
definition, 625 
example, 636-640 
Phase V (robust product/process design) see also Taguchi 
robustness concepts 
definition, 625-626 
example, 640-644 
employees 
change, 15 
project selection, 188 
rewards see compensation 
satisfaction, 194 
stakeholder, 194 
encouragers, 176 
end users, data warehousing, 75 
energizers, 175 
enumerative statistics see statistics 
equivalent performance rates, 60-61 
estimated savings from Six Sigma, 30 
ethical principles, 155 
evaluation of training 
levels, 164 
targets, 165 
evaluators, 175 
Evolutionary Operation (EVOP), 640 
EVOP, 640 
EWMA, 453-466 see also statistical process control (SPC) 
action limits, 455 
automated manufacturing, 453—454 
common cause charts, 455-458 
computation, 456 
control charts, 458—463 
example, 457-458 
special cause charts, 465 
“exciting” quality, 120 
exclusive OR gate, 592 
executive councils 
organizational roles/responsibilities, 39 
project selection, 188 
expected quality, 120 
expenditure see costs 
experimental area, 608 
experimental error, 609 
experiment design, 726 
experts (team problem role), 174 
exploratory data analysis (EDA), 240, 381-385 
boxplots, 384-385, 386 
stem-and-leaf plots, 382-384 
themes, 381 
exponential distribution, 304-306 
example, 305 
exponentially weighted moving averages see EWMA 
external failure costs see costs 
external process elements, 653 
external roadblocks, 561 
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extreme values, boxplots, 384 


facilitation, 178-182 
necessity, 178 
principles, 179-181 
team maintenance, 182 
teams, 181—182 
facilitators 
communication, 182 
conflict management, 171 
meeting management, 182 
roles, 181-182 
selection, 178-179 
skills, 161-162 
factorial experiments, 726 see also empirical model building 
factors, 726 
failure costs, 220 
failure mode and effect analysis (FMEA), 240, 596-600 see also 
risk assessment 
approaches, 596-597 
process, 597-600 
process control planning, 652 
rating guidelines, 598-599 
worksheet, 601 
failure mode, effects and criticality analysis (FMECA) 
process decision program charts, 265-267 
project management, 536 
failure rates, 572 
fault-tree analyses (FTAs) 
definition, 572 
example, 593 
project management, 536 
risk assessment, 591 
symbols, 592 
F distribution, 309-310, 311 
statistical tables, 738-741 
feasibility, 189 
feedback loops, 543-544, 555-556 
feedback, self-managed teams, 171 
feedforward, 555-556 
feuds, in teams, 174 
FFA see force field-analysis (FFA) 
field experiments, 103 
fill-in-the-blank questions, 105 
financial analysis, 212-233 see also budgets; costs; project 
tracking 
accounting support, 223-224 
benefit and cost, 212 
benefits, 193 
break-even analysis, 213 
break-even points, 213 
cost of quality, 219-221 
future value, 214 
project evaluation, 193 
revision, 650-651 
time value of money, 212, 214-215 
values, 214 
financial metrics, 70-71 
5S (five S), 715 
fixed costs, 212 
fixed process elements, 653 
flattened hierarchies, 98 
flexible process, 716 
flow charts, 254-255 
elements, 254 
process capability analysis, 256 
symbols, 255 
flow value see lean manufacturing 
FMEA see failure mode and effect analysis (FMEA) 


FMECA see failure mode, effects and criticality analysis 
(FMECA) 

focus groups, 113-114 see also surveys 
advantages, 114 
definition, 113 
disadvantages, 114 
organization culture assessment, 27 
utility, 113-114 

followers, 176 

force field-analysis (FFMFFA), 275-276 
process control planning, 652 

force field diagrams, 240 

formal reports, 569-570 

forming stage, 173 

freaks, control charts, 420-421, 421 

frequency distributions, 291 
definition, 726 

Friedman test, 532 

“funnel rules,” 429-430 

future value, 214 


gaming the system, 90 
Gantt charts, 535, 544-545 
gate-keepers, 176 
gate symbols, 592 
Gaussian distributions, 300 
global importance weights see importance weights 
goals, 56-96 
definition, 77, 98 
goodness-of-fit, normality assumption, 494 
Green Belts see also Black Belts; change agents; Master Black 
Belts 
effectiveness certification, 791-803 
implementation phase, 21, 29 
information systems, 65 
organizational roles/responsibilities, 41-42 
project tracking, 209 
selection criteria, 49 
selection process, 38, 43-45, 48, 49 
training, 29, 158, 159 
Guttman format, 106 


hard savings, 211 
harmonizers, 176 
hazard plots, 533 
help-seekers, 177 
histograms, 371-381 
construction, 372—373 
definition, 371, 726 
example, 373-380 
layout, 373 
normal curves, 493 
use, 380-381 
house of quality 
process control planning, 652 
QED, 121, 122 
hypergeometric distribution, 297-299 
example, 299 
hypotheses 
alternative, 726 
definition, 6 
null, 726 
testing, 315-317 
sample mean, 315-316 
sample variances, 316 
standard deviations, 317 


ID see interrelationship digraphs (IDs) 
implementation phase, 20-54 
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Black Belts, 28-29 
champions, 28 
Green Belts, 29 
infrastructure, 25-26 
key issues, 37 
leadership, 27—28 
Master Black Belts, 29 
roles and responsibilities, 21 
sponsors, 28 
supply chain deployment, 51-54 
supply chain management, 52-53 
timetable, 22—24 
importance weights 
Black Belts skills, 45-46 
category, 145-146 
DMADYV, 676-677, 679 
global, 147-149 
alternative assessment, 149 
DMADYV, 678, 679, 680 
resource allocation, 147 
local, 147, 148 
subcategory, 146-147 
DMADYV, 677, 679 
improvement initiatives, continuous, 69 
incidents, critical, 110 
independent variables, 496, 504 
definition, 608 
indirect costs, 554 
individual measurements control charts (X charts) see control 
charts 
inferences, 287 
inferential statistics, 240 
informal reports, 569-570 
information capture, project tracking, 210 
information givers, 175 
information overload, 9 
information seekers, 175 
information systems see also data 
balanced scorecard, 64-65 
data mining see data mining 
data warehousing, 74-75 
“drill-down” capabilities, 64, 65 
integration, 74 
modification, 651 
on-line analytic processing see on-line analytic processing 
(OLAP) 
requirements, 74-79 
infrastructure 
construction, 3-55 
implementation phase, 25-26 
modern organization, 168 
inhibit gates, 592 
initiators, 175 
innovation and learning perspective, 69-70 
in-process control, 726 
inputs, flow charts, 254 
integrated quality initiatives, 538 
integration 
in benchmarking, 92 
into other systems, 49-51 
integration work breakdown structure, 542 
intensity scale questions, 106 
interactions, 609 
interdepartmental teams, 168 
internal failure costs see costs 
internal process elements, 653 
internal process perspective, 67-69 
internal rate of return, 217—219 
definition, 217 


internal roadblocks, 560-561 

Internet, in benchmarking, 93 

interrelationship digraphs (IDs), 270-271 
7M tools, 268-269 

interval data, 80 

interval estimation, 310-314 

interval scales, 278 

interview plans, surveys, 109 

inverse Chi-square, 308 

ISO 900X, 240 


Juran trilogy, 655-656 
just-in-time inventory control (JIT), 655 
just-in-time training JITT) 

training refreshers, 166 

training reinforcement, 165—166 


KAIZEN, 49, 187, 717-720 see also lean manufacturing 
hierarchy, 719 
process maps, 253 
quality costs, 222 
responsibilities, 718 
role, 718 
Kano model, 119-121 
knowledge assessment, 151 
knowledge discovery, 361—392 see also empirical model 
building 
tools, 361-385 see also individual tools/methods 
knowledge skills and abilities (KSAs), 150 
Kruskal-Wallis test, 531 
KSA, 150 
kurtosis, 370 
definition, 726-727 
illustration, 371 


leadership see also management 
in benchmarking, 95 
change management, 13, 18-19 
communications, 36, 153-154 
conflict resolution, 154-155 
definition, 8 
ethical principles, 155 
implementation phase, 21, 27-28 
organizational roles/responsibilities, 35-37 
training, 153-155 
lean manufacturing, 49, 705-723 see also KAIZEN 
attainment, 720-721 
CLOSEDMITTS, 708, 709 
constraint management, 715 
elements, 722 
flexible process, 716 
muda 
definition, 705-706 
types, 708 
perfection goal, 716-717 
Six Sigma synergy, 723 
Six Sigma vs., 721-723 
value definition, 707-708 
value flow, 711-713 
customer pull, 713-716 
level loading, 715 
lot size reduction, 716 
spaghetti charts, 712-713 
Takt time, 711-712 
tools, 714-716 
value stream, 51, 708-711 
mapping, 710-711 
value to customers, 706-708 
lean service, 49 
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learning 
models, 241-251 see also DMADV; DMAIC 
dynamic models, 245-247 


Plan-Do-Check-Act see Plan-Do-Check-Act (PDCA) 


Plan-Do-Study-Act, 244-245 


Select-Experiment-Adapt see Select-Experiment-Adapt 


(SEA) 


Select-Experiment-Learn see Select-Experiment-Learn 


(SEL) 
training evaluation, 163 
least-squares fit see correlation analyses 
lessons, 163 
level loading, value flow, 715 
Levene’s test, 533 
Likert survey question format, 106 
Limits (tolerance), 600, 602 
linearity, 341-346 
attribute measurement concept, 348 
definition, 280, 341 
example, 341-345 
illustration, 284 
linear models 
correlation analysis, 502-510 
transformations, 504, 505 
linear regression, least-squares fit, 509 
listening posts, structured decision making, 141 
local importance weights, 147, 148 
locations, 319 
logistic regressions, 516-518 
binary, 516, 519-522 
interpretation, 519-522 
logit, 517 
nominal, 516, 526-528 
chi-square comparison, 528 
example, 526-528 
odds ratio, 518-519 
ordinal, 516, 522-525 
example, 522-525 
types, 516 
logit, 517 
lot size reduction, value flow, 716 
lurking variables, 513 


Macabe approach, to QFD, 122, 123 
machine capability study, 657 
maintainability, 572 
management see also leadership 
in benchmarking, 95 
KAIZEN role, 719 
of projects see project management 
reviews, 543 
structures, 128—130 
Process Enterprise, 129-130 
traditional, 128-129 
team-dynamics, 171-182 
teams, 177-178 
traditional, 12 
Mann-Whitney test, 531 
manpower forecasts, 651 
manufacturing planning, 650 
market-driven organizations, 97-98 
marketing focus, 99 
mass training, 43—44 
Master Black Belts see also Black Belts; change agents; 
Green Belts 
implementation phase, 29 
organizational roles/responsibilities, 40-41 
Process Enterprise implementation, 131 


selection process, 38, 43-45, 48 
skills, 29 
strategy deployment plant, 73 
as trainers, 156 
material plans, 538 
matrix charts, project management, 536 
matrix diagrams, 7M tools, 268 
“Matrixed” Project Manager, 43 
maturity, in benchmarking, 92 
mean (population) (1), 368 
calculation, 300-302 
definition, 727 
estimates, 312-314 
illustration, 370 
known o, 312-313 
unknown o, 313-314 
mean (sample), 368 
definition, 293, 727 
hypothesis testing, 315-316 
illustration, 285 
mean, standard error of, 727 
mean time between failures (MTBF) 
definition, 572 
example, 574 
mean time to first failure (MTTF/MTFF), 572 
mean time to repair (MTTR), 572 
measurements see also data 
definitions, 277, 280-283 
elements, 57 
principles, 277-324 
scales, 277-279 
systems 
analysis, 240, 325-360 
bias, 328-329 
continuous data see R&R studies 
discrimination, 325-326 
example, 336 
part-to-part variation, 335-336 
repeatability, 329-332 
reproducibility, 332-335 
stability, 327 
in process capability analysis, 469 
Measure Phase in DMADV see DMADV 
median, 369 
definition, 727 
illustration, 370 
run charts, 362 
meeting management, facilitators, 161, 182 
mentoring 
definition, 160 
project management implementation, 564 
metadata, 75 
metrics, 33—34, 56—96 
attributes, 56—58 
in benchmarking, 95 
milestones 
charts, 535, 545 
customer-driven organizations, 97 
mission statements see project management 
mixtures, in control charts, 425, 426 
mode, 369 
definition, 727 
illustration, 370 


model-based inference, enumerative statistical methods, 288 


mode of operation, organizational comparisons, 100 
modern organization structure, 168 

Monte Carlo simulation, 577 

Mood’s median test, 531 
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m-out-of-n gate, 592 

moving range charts see control charts 
MTBE see mean time between failures (MTBF) 
MTFF, 572 

MTTE, 572 

MTTR, 572 

muda see lean manufacturing 
“multi-bossed” individuals, 566, 567 
“multiple bosses,” 566, 567 

multiple correlation, coefficient of, 725 
multiple R, 510 

multiple sampling, 727 

multitasking, project evaluation, 205-207 
Murphy’s law, 242 

mystery shoppers, 115 


natural tolerance, 473 
negative customer value, 224 
negotiations, 160 
net present value (NPV), 216-217 
customer retention, 117 
definition, 216 
NGT, 274-275 
nominal data see data, nominal 
nominal group technique (NGMNGT), 274-275 
nominal regressions see logistic regressions 
nominal scales, 278-279 
definition, 278 
non-annual compounding periods, 215 
non-parametric Dist analysis, 533 
normal curves 
area under, tables, 730-732 
normality assumption, 493-495 
normal distribution, 299-303, 427 
norming stage, 173 
norms 
change, 15-16 
definition, 15 


notional metrics, performance measurement model, 59 


np charts see control charts 
NPV see net present value (NPV) 
null hypotheses, 288, 726 


observations, regression analysis, 511 
observer/commentators, 176 
OCC, 598-599 


occurences-per-unit control charts (c charts) see control charts 


occurrence (OCC), 598-599 
OC curve, 727 
odds ratio, logistic regression, 518-519 
OLAP see on-line analytic processing (OLAP) 
OLAP cube, 75, 77 
1-sample sign test, 531 
1-sample Wilcoxon test, 531 
on-line analytic processing (OLAP), 64, 75-76 
and data mining, 79 
knowledge discovery tools, 361 
OLAP cube, 75, 77 
open-ended questions, 105 
Operating Characteristics curve (OC curve), 727 
operational definitions, 348-350 
operational feedback, data warehousing, 75 
operationalizing goals, 67 
operations 
deploying from differentiators, 136-138 
deploying to projects, 138-140 
opinion givers, 175 
opinion seekers, 175 


opinions over facts, 174 
ordinal data see data, ordinal 
ordinal logistic regressions see logistic regressions 
ordinal scales, 279 
binomial distribution, 279 
definition, 278 
Pearson correlation, 279 
Poisson distribution, 279 
organizations 
culture, assessment, 26—27 
key requirements 
denominator management, 90 
process behavior charts, 91 
setting, 89-96 
roles/responsibilities, 35-38 
leaders, 42 
managers, 42 
Black Belt, 37-38, 41 
certification board, 40 
core team, 40 
director, 39-40 
executive council, 39 
Green Belt, 41-42 
Improvement Team, 43 
improvement team, 42 
leadership, 35-37 
Master Black Belt, 40-41 
“Matrixed” Project Manager, 43 
sponsors, 43 
structure, 127—130 
as internal roadblocks, 561 
traditional, 98 
OR gate, 592 
orientors, 175 
outliers, boxplots, 384 
outliers/tail perspectives 
ordinal data dashboards, 85 
scale data dashboards, 83 
out-of-control patterns, control charts, 427 
outputs, flow charts, 254 


pairwise averages test, 532 
pairwise comparisons, 145-146 
pairwise differences test, 532 
pairwise reproducibility 
definition, 352, 354 
measurement system, 352-356 
pairwise slopes test, 532 
parameters 
definition, 727 
measurement, 9 
performance measurement model, 57-58 
Pareto analysis, 240, 259-261 
definition, 198, 259 
“curing diseases,” vs treating symptoms 198-199 
example, 260-261 
nominal data dashboards, 89 
performance, 259-260 
process symptoms, 198-199 
project identification, 198-200 
project management, 535-536 
quality cost management, 225 
usage, 259 
Pareto Priority Index, 199-200 
calculation, 199 
patterns, data mining 
deployment, 78 
discovery, 78 
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patterns, data mining (continued) 
presentation, 78 
validity monitoring, 78-79 
PCA see process capability analysis (PCA) 
p charts see control charts 
PCP see process control planning (PCP) 
PDCA see Plan-Do-Check-Act (PDCA) 
PDPC see process decision program charts (PDPC) 
PDSA see Plan-Do-Study-Act (PDSA) 
Pearson’s product-moment correlation, 513 
ordinal scales, 279 
PELTs, 50-51, 130-131 
people organization, 100 
performance 
customer scorecard, 66 
indicators, 57 
measurements 
model, 57-58 
organizational comparisons, 99 
quality correspondence, 5, 6 
team evaluations, 182-183 
performing stage, 173 
permutations, 289 
personal change, 562 
PERT see program evaluation and review technique (PERT) 
PEX see Process Excellence (PEX) 
philosophy, Six Sigma 6-8 
PID equation, 466 
Plan-Do-Check-Act (PDCA), 243-245 
personal change, 562 
Shewhart-Deming cycle, 244-245 
Plan-Do-Study-Act (PD SA), 244-245 
application guidelines, 250 
example, 250-251 
Select-Experiment-Adapt vs., 248 
Select-Experiment-Learn vs., 249-250 
planned changes, control charts, 424 
planning, 536-538 
in benchmarking, 92 
integrated quality initiatives, 538 
process control planning, 651-652 
project decomposition, 536-538 
project plan, 535 
playboys, 177 
point estimation, 310-314 
Poisson distribution, 295-297 
example, 296-297 
ordinal scales, 279 
probability sums, 742-745 
policy changes, 649 
population, 727—728 
population mean (j1) see mean (population) (1) 
population standard deviation (0) see standard deviation 
(population) (o) 
population variance (0°) see variance (population) (o’) 
potential quality, 5 
power curves, 728 
power functions, ANOVA, 761-769 
precision, 281 
PRE-Control, 661—664 see also process control planning (PCP) 
establishment, 662-663 
run phase, 663-664 
setup quantification, 663 
use, 663—664 
zones, 662—663, 664 
predictable variation, 321-322 
prediction limits, 602 
predictor variables, 504 


preliminary requirements work breakdown structure, 541 
presentation see communication 
present value 
definition, 214 
net, 216-217 
prevention costs see costs 
price updates, 650 
primary variables, 609 
prioritization, 9-10 
prioritization matrices, 269-270 
Analytical Hierarchical Process, 270 
combination method, 270-271 
consensus criteria method, 271-272 
full analytical criteria, 270 
priority AND gate, 592 
problem solving tools, 252—276 see also individual tools 
problem statements, 538 
procedure modifications, 650 
procedure technicians, 175 
process 
audit, 658 
baseline, 385—388 
behavior charts, 91, 240 
in benchmarking, 95 
capability, 58, 728 
central tendency, 84 
check sheets, 256, 257 
definition, 125 
examples, 126-127 
in process capability analysis, 469 
process capability analysis (PCA), 467-489 
flow charts, 256 
indices see process capability indices 
methods, 467—471 
non-normal distribution, 478—484 
normal distribution, 475-478 
process yield estimation, 484-489 
normalized, 487—489 
rolled throughput yield, 484-486 
statistical analysis, 471-472 
attribute data control charts, 471 
variables data control charts, 471-472 
process capability indices, 472-475, 656 see also individual 
indices 
interpretation, 473-475 
process control planning (PCP), 649-664 see also PRE-Control; 
statistical process control (SPC) 
attribute control charts, 654 
brainstorming, 652 
control charts, 654 
FMEA process, 652 
force field-analysis, 652 
gains, maintenance of, 649-652 
house of quality, 652 
plan preparation, 652-654 
process decision program charts, 652 
project planning, 651-652 
short runs, 655-661 
Juran trilogy, 655-656 
plan preparation, 656-657 
process audit, 658 
process control element selection, 658-661 
single-part process, 660-661 
tools/techniques, 651-652 
process control systems, 321 
process decision program charts (PDPC) 
7M tools, 265-267 
process control planning, 652 
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project management, 536 
sort-term plans, 565 
process elements, 653 
Process Enterprise, 125-140 
definition, 129 
implementation, 131-132 
management structure, 129-130 
Process Excellence (PEX), 49-51, 130-131 
definition, 50-51 
project evaluation, 191 


Process Excellence Leadership Teams (PELTs), 50-51, 130-131 


Process Failure Mode and Effects Analysis, 89 
process focus, 50 
process improvement teams, 169-169 
process management approach, 99 
process maps, 126, 240, 252-254 
cross-functional, 253-254 
definition, 252 
types, 253 
process quality, 59 
process scale tendency, 82 
process scrap rates, 203 
process standard deviation, 327 
process stream, 50 
process symptoms, Pareto analysis, 198-199 
process yield estimation, 484-489 
producer’s risk («), 728 
product delivery, organizational comparisons, 100 
product planning, organizational comparisons, 99 
product quality, organizational comparisons, 99 


program evaluation and review technique (PERT), 273, 545, 


547-552 
example, 548-549 
Project Impact Score, 139 
project management, 534-570 
budgets, 558-560 
analysis, 559-560 
reports, 558-559 
types, 558-560 
communication, 555 
continuous review, 567—568 
cross-functional collaboration, 566-567 
communication, 566—567 
matrix structures, 566 
DMAIC tasks and responsibilities, 545, 546-547 
documentation and procedures, 568-570 
feedback loops, 543-544, 555-556 
feedforward, 555-556 
implementation, 560-570 
effective strategies, 564 
external roadblocks, 561 
individual barriers, 562-563 
ineffective strategies, 563-564 
internal roadblocks, 560-561 
performance measures, 544-556 
PERT-CPM systems, 545, 547-552 
schedule slippage prevention, 550-552 
project charters, 240, 538-541 
problems, 541 
project evaluation, 197 
resources, 552—560 
conflicts, 552 
cost considerations, 552-555 
methodology, 552-556 
short-term (tactical) plans, 565 
stakeholders, 556-557 
tools and techniques, 535-538 
work breakdown structures, 541-542 


example, 542 
projects 
budgets, 558 
champions, 253 
charters see project management 
definition, 187, 534-535 
deploying from operations, 138-140 
evaluation, 189-197 
approach value, 197 
benefit—cost analysis, 189-190 
Black Belt effort, 196 
completion time, 197 
deliverability, 196 
DMAIC, 197 
employee stakeholder, 194 
external customer stakeholder, 192-193 
guidelines, 192-197 
multitasking, 205-207 
Process Excellence, 191 
project charter, 197 
resource availability, 195 
sample forms, 191-197 
shareholder stakeholder, 193-194 
sponsorship, 192 
stakeholder benefits, 192-195 
summary, 209 
team membership, 197 
throughput vs. focus, 204 
identification, 198—208 
Pareto analysis see Pareto analysis 
QED, 198 
launch synchronization, 207 
linked to strategies, 132-140 
management see project management 
planning see planning 
re-education, 233-234 
replication, 233-234 
scheduling, 205-207 
critical chain project portfolio management, 206-208 
project launch synchronization, 207 
start dates, 207-208 
synchronizer resource, 207 
selection, 188-208 see also theory of constraints (TOC) 
customer-driven projects, 189 
process, 73 
shareholder projects, 189 
throughput-based, 201-203 
tracking, 208-234 
Black belts, 209 
change agents, 209 
data storage, 209 
financial results validation, 211-233 see also financial 
analysis 
Green Belts, 209 
information capture, 210 
organization, 210 


proportion defective control charts (p charts) see control charts 


pull systems, value flow, 715-716 
purchased items budgets, 558 
P-value, normality assumption, 494 
Pyzdek’s Law, 7 


QED see quality function deployment (QFD) 
quality 

actual, 5 

basic, 119 

customer scorecard, 66 

definition, 5, 721, 728 


826 Index 


quality (continued) 
exciting, 120 
expected, 120 
performance correspondence, 5, 6 
potential, 5 
quality appraisal, 650 
quality assurance, 728 
quality circles, 169-170 
quality control 
definition, 728 
plans, 537 
quality costs, 5, 219-223 
bases, 228-229 
classical model, 222 
definitions, 5, 220 
examples, 226-228 
goal, 221-222 
as hidden costs, 221 
management, 224-225 
new model, 223 
program implementation, 231-232 
reduction, 222-223 
benefits, 233 
summary report, 230 
total, 220 
trend analysis, 229, 231 
use, 232 
quality function deployment (QFD), 121-125, 240, 268 
customer interaction, 122-125 
data collection, 122-125 
deploying differentiators to operations, 136-138 
deploying operations to projects, 138-140 
house of quality, 121, 122 
interpretation, 138-140 
linking projects and strategies, 132-140 
Macabe approach, 122, 123 
matrix, 122, 124, 133, 139 
differentiators, 137 
project management, 536 
project selection, 188 
relationship weight, 135 
symbols, 135 
Quality Improvement (CTQ) 
affinity diagrams, 669 
DMADYV, 671, 678-681 
DMADYV linking, 671, 678-681 
identification, 667 
importance, 668-670 
performance prediction, 682-685 
project assessment, 193 
project focusing, 204 
quality level, 119 
quality score cards, simplified, 452-453 
questionnaires, organization, 27 


randomization, 611 
random number generators, 577-578, 579-580 
random sampling, 728 
range (R), 369 
definition, 728 
ranges control charts see control charts 
ranking questions, 105 
rating questions, 105 
ratings distribution, 84-85 
ratio data, 80-81 
ratio scales, 278, 279 
R chart method, process standard deviation, 327 
readiness evaluation, 27 


recognition-seekers, 177 
recorders, 175 
re-engineering, 126 
quality costs, 222 
re-expression, exploratory data analysis, 381 
refresher training, 166 
regression analysis, 502-514 see also correlation analyses; 
scatter plots 
ANOVA, 511 
curvilinear relationship, 503-504 
data space, 505-506 
example, 510-512 
extrapolations, 505 
least-squares fit, 508-514 
linear regression, 509 
standard error, 508 
linear models, 502-510 
output interpretation, 510-512 
transformations, 504, 505 
variable types, 504 
Relative Metric Weight, QFD, 135 
reliability, 280-283 
definition, 280, 571 
reliability analysis see risk assessment 
reluctant participants, 174 
remuneration see compensation 
repeatability, 329-332 
between appraisers, 352-356 
within appraisers, 356 
attribute measurement concept, 347 
calculation, 354-355 
definition, 280-281 
example, 329-332 
illustration, 282 
measurement system, 330, 352-356 
stability of, 355 
repeating patterns, control charts, 423—424 
replication, 611, 729 
reporting plans, 538 
reports 
formal, 569-570 
informal, 569-570 
project management, 568-570 
status, 543 
reproducibility 
attribute measurement concept, 347 
calculation, 354-355 
definition, 280, 281 
example, 332-335 
illustration, 282 
measurement systems analysis, 332-335 
pairwise, 352-356 
stability of, 355 
resampling, 317-318 
residuals, exploratory data analysis, 381 
resistance, exploratory data analysis, 381 
resolution, measurement systems analysis, 325-326 
resource allocation 
global importance weights, 147 
in process capability analysis, 469 
project evaluation, 195 
response variables, 504 
definition, 609 
results measurement 
customer-driven organization, 101-102 
training evaluation, 164 
retention, change agents, 54-55 
return on investment (ROI), training evaluation, 164 
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revenue enhancement, project evaluation, 194 
rewards see compensation 
risk assessment, 571-606 see also failure mode and effect 
analysis (FMEA); statistical tolerancing 
example, 595-596 
reliability analysis, 571-590 
apportionment, 573-574 
design, 576-577 
mathematical models, 573 
Monte Carlo simulation, 577 
parallel systems, 575, 576 
prediction, 576-577 
series systems, 574-575 
simulation modeling, 578-590 
system effectiveness, 577 
system types, 573-576 
terms and principles, 571-572 
safety analysis, 591-596 
safety factors, 593-594 
tools, 590-591 
design review, 591 
fault-tree analysis, 591 
risk taking, customer-driven organizations, 100 
roadblocks, project management implementation, 560-561 
robustness, 290-291 
robust process design phase see empirical model building 
robust product design phase see empirical model building 
rolled throughput yield (RTY) estimation 
process capability analysis, 484-486 
simulations, 488—489 
root causes, 63 
R&R studies, 325-346, 337-341 
ANOVA, 338, 339-340 
example, 337-341 
output, 338-341 
R square, regression analysis, 511 
RTY see rolled throughput yield (RTY) estimation 
run charts, 240, 361-368 
analysis, 362-363 
general rules, 365-368 
preparation, 362-363 
run length determination, 363-364 
run number determination, 364, 365, 366 
trends, 365, 367 
run phase, PRE-Control, 663-664 
Runs test, 532 


safety analysis see risk assessment 
safety factors, 593-594 
sample mean see mean (sample) 
samples, 729 
sample standard deviation (s) see standard deviation (sample) (s) 
sample surveys, 102 
sample variance (s?) see variance (sample) (s) 
sampling 
double, 726 
multiple, 727 
random, 728 
single, 729 
savings, 211 
scale data dashboards see dashboards 
scatter plots, 496-502 see also correlation analyses; regression 
analysis 
definition, 496 
example, 499-500, 500 
importance, 506-507 
interpretation guide, 501 
layout, 498 


method, 492, 497-498 
use, 497 
pointers, 500-502 
s chart method, process standard deviation, 327 
schedule control plans, 537 
SCM, supply chain management, 52-53 
screening experiment phase see empirical model building 
SEA see Select-Experiment-Adapt (SEA) 
SEL see Select-Experiment-Learn (SEL) 
Select-Experiment-Adapt (SEA), 242, 246-251 
application guidelines, 250 
example, 250-251 
“learning,” 248-251 
Plan-Do-Study-Act vs., 248 
Select-Experiment-Learn (SEL), 242, 249-251 
application guidelines, 250 
example, 250-251 
learning models, 242 
Plan-Do-Study-Act vs., 249-250 
self-managed teams, 170-171 
sematic differential format, 106-107 
sequential learning see empirical model building 
service 
customer scorecard, 66 
delivery, 100 
planning, 99 
quality, 99 
setup quantification, PRE-Control, 663 
SEV, severity, 598-599 
7M tools, 240, 264-276 
activity network diagram, 276 
affinity diagrams, 264-265, 266 
consensus criteria method, 271-272 
interrelationship digraphs, 268-269, 270-271 
matrix diagrams, 268 
prioritization matrices see prioritization matrices 
process decision program charts, 265-267 
tree diagrams, 265, 267 
severity (SEV), 598-599 
shareholders 
project selection, 188 
value projects selection, 188 
Shewart quality improvement PDCA cycle, 116 
Shewhart-Deming cycle, 244-245 
short runs 
definition, 655 
process control planning see process control planning (PCP) 
“should-be” maps, 253, 254 
sigma control charts see control charts 
“silos,” 560 
simplified quality score cards, 452-453 
single sampling, 729 
SIPOC, 240, 388-392 
creation, 389-390 
definition, 67-68 
example, 390-392 
undesirable outcomes, 392 
skewness, 370 
definition, 729 
illustration, 371 
skills assessment, 151 
slack time, 549 
small runs see short runs 
“smoke stacks,” 560 
soft savings, 211 
“soft skills“ 
range, 160 
training, 158-161 
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SOP see standard operating procedures (SOPs) 
source systems, data warehousing, 75 
spaghetti charts, value flow, 712-713 
SPC see statistical process control (SPC) 
special cause charts, EWMA, 465 
special causes of variation, 322, 420 
special-interest pleader, 177 
specific metrics, 59 
sponsors 
in benchmarking, 94 
cascade, 15 
change management, 14 
definition, 8 
implementation phase, 28 
organizational roles/responsibilities, 43 
project evaluation, 192 
spread, 319 
stability 
attribute measurement concept, 348 
calculation, 355-356 
definition, 281 
illustration, 283 
measurement systems analysis, 327 
parameters of, 355 
stabilized attribute control charts see control charts 
staffing levels, 30 
staffing plans, 538 
stakeholders 
benefits, project evaluation, 192-195 
definition, 62, 556 
identification, 557 
linkage, 139 
project management, 556-557 
standard deviation (population) (o) 
calculation, 300-302 
definition, 729 
hypothesis testing, 317 
illustration, 371 
process, 327 
standard deviation (sample) (s), 369 
definition, 293, 729 
standard deviation control charts see control charts 
standard error (of the mean) 
definition, 293, 727 
least-squares fit, 508 
regression analysis, 511 
sample size effects, 294 
standard operating procedures (SOPs), 717 
as internal roadblocks, 560 
standard requirements, 72 
standards, 649-650 
standard setter, 176 
statistical process control (SPC), 240, 393-453 see also control 
charts; EWMA 
attribute data, 443-445, 445 


automated manufacturing, 453-454, 465-466 see also EWMA 


empirical control equation, 466 
PID equation, 466 
basic rules, 322 
central limit theorem, 319, 320 
concepts, 318-319 
definition, 322 
distributions, 318-319 
empirical model design (Phase 0), 626 
objectives/benefits, 319-321 
prevention vs. detection, 320-321 
principles, 318-324 
problems, 454 


in process capability analysis see process capability analysis 
(PCA) 
process control, 652-654 see also process control planning 
(PCP) 
element selection, 658-661 
quality score cards, 452-453 
rules, 426—428 
run tests, 426—428 
short runs, 430-445, 655-661 
code value charts, 431, 436-439 
exact method, 431, 432-436 
stabilized control charts, 432, 439-443 
variables data, 431-432 
tampering effects, 429-430 
terms, 318-319 
statistical tolerancing, 600-606 see also risk assessment 
calculation, 602—605 
definition, 602 
example, 602-605 
formula assumptions, 605 
statistics, 729 see also individual methods; individual 
parameters 
analytical 
definition, 286—287 
enumerative methods vs., 283-287 
assumptions testing, 490-496 
cause-and-effect, 490-533 
descriptive, 240, 368-371 see also individual parameters 
in different measurement scales, 278 
enumerative, 240, 287-290 see also individual methods 
analytic methods vs., 283-287 
definition, 286—287 
design-based inference, 288 
external validity, 288 
inference, 287 
methods, 289-290 
model-based inference, 288 
equal variance assumption, 496, 497 
glossary of terms, 724-729 
independence assumption, 492—493 
inferences, 310-314 
inferential, 240 
non parametric tests, 528-533 
pointers, 533 
normality assumption, 493-496 
goodness-of-fit, 494 
graphical evaluation, 493-495 
normal curves, 493-495 
P-value, 494 
overview, 283-325 
process capability analysis see process capability analysis 


tables, 730-772 
status reports, 543 
steepest ascent phase see empirical model building 
stem-and-leaf plots, 382-384 
storming stage, 173 
Strategic Importance Score, QFD, 135, 136 
strategic training plans, 152-166 
benefits, 153 
strategies, linked to projects, 132-140 
Strategy Deployment Matrix, 133-136 
Strategy Deployment Plans, 71-74 
definition, 132-133 
interpretation, 138-140 
strategy linkage, 136-137 
stratified defect check sheets, 257, 258 
stream value see lean manufacturing 
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structured decision making, 140-145 
Student’s t test, 309, 310, 313-314, 493 
of bias, 346 
statistical tables, 733-734 
subcategory importance weights see importance weights 
subgroup equations 
averages and ranges control charts, 394 
averages and standard deviation control charts, 398 
subprocesses, 127 
suggestion systems, 114 
suppliers, inputs, process activities, outputs and customers 
(SIPOC) see SIPOC 
supply chain, deploying Six Sigma to, 
implementation phase, 51-54 
supplier’s responsibilities, 53-54 
supply chain management (SCM), 52-53 
support networks, change agents, 18 
support service budgets, 558 
surveys, 102-113 see also focus groups 
administration, 112 
case studies, 103 
case study, 107-112 
Critical Incident Technique, 108 
customer, 773-776 
data 
classification, 109-110 
collection, 109 
interpretation, 110-111 
field experiments, 103 
general aim establishment, 108-109 
interview plan, 109 
item development, 111-112 
pilot study, 112 
question development, 103-104 
response types, 105-107 
results, 103 
sample see sample surveys 
total design method, 112 
suspected differences, control charts, 425 
synchronizer resource, project scheduling, 207 


Taguchi robustness concepts, 641-644 see also empirical model 
building 
expected loss, 642-644 
noise, 644 
off-line quality control, 641-642 
parameter design, 641-642 
system design, 641 
tolerance design, 642 
on-line quality control, 641 
performance statistics, 644 
summary, 644 
Takt time, 711-712 
tampering effects, SPC, 429-430 
TDM, survey design, 112 
teams, 167—186 
core 
compensation issues, 54-55 
organizational roles/responsibilities, 40 
counterproductive roles, 176-177 
definition, 179 
dynamics 
management, 171-178 
stages, 172-173 
effective characteristics, 179-181 
facilitation, 181-182 
group task roles, 175 
Improvement, 42, 43 


interdepartmental, 168 
leaders 
conflict management, 171 
cross-functional process mapping, 253 
principles, 179-181 
roles, 181 
maintenance roles, 176 
management roles, 177-178 
member roles/responsibilities, 173-178 
members, 167 
cross-functional process mapping, 253 
project evaluation, 197 
performance evaluation, 182-183 
problems, 173-175 
Process Excellence Leadership Teams (PELTs), 50-51, 
130-131 
process improvement, 169-169 
productive roles, 173-176 
quality circles, 169-170 
recognition/rewards, 182-183 
self-managed, 170-171 
skills 
in benchmarking, 94-95 
Black Belts, 47 
Green Belts, 49 
work groups, 169-170 
technical skills 
Black Belts, 47 
change agent training, 161 
Green Belts, 49 
theories, 6 
theory of constraints (TOC), 49, 201-205 see also projects; 
project selection; throughput-based project selection 
method, 201—202 
project focusing, 203-205 
TQM vs., 202-203 
Three Sigma performance, 58-61 
throughput-based project selection, 201-203 see also theory of 
constraints (TOC) 
throughput priorities, 205 
time investment, change management, 16-18 
timeliness, customer scorecard, 66 
time of completion, 549 
timetables, 8—9 
implementation phase, 22—24 
to performance levels, 23 
time value of money (TVM), 212, 214-215 
TOC see theory of constraints (TOC) 
tolerance interval factors, statistical tables, 746-749 
tolerance limit, 602 
tolerancing, statistical see statistical tolerancing 
total costs, 555 
total design method (TDM), 112 
total quality costs, 220 
Total Quality Management (TQM), 3-4, 49 
benefits, 10 
theory of constraints vs., 202-203 
TQM see Total Quality Management (TQM) 
traditional organizations 
customer-driven organizations vs., 99-100 
management structures, 128-129 
structure, 168 
training, 12, 150-166 see also strategic training plans 
Black Belts, 28, 155-158 
change management, 13, 16 
definition, 150 
evaluation, 162-165 
Green Belts, 29, 158, 159 
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training (continued) 
implementation phase, 21 
leadership, 153-155 
lesson, 163 
managers, 44 
mass, 43—44 
modification, 651 
needs analysis, 150-151 
refreshers, 166 
reinforcement, 162-163, 165-166 
self-managed teams, 171 
“soft skills,” 158-161 
transfer functions, 63-64 
translation, 674 
treatments, 608 
tree diagrams, 240 
7M tools, 265, 267 
project management, 565 
t tests see Student’s t test 
turnaround stage, 98 
TVM, 212, 214-215 
type errors, 315, 729 
type Ierrors, 315, 729 


typical subsystem work breakdown structure, 542 


u charts see control charts 


union role, customer-driven organization, 101 
unit managers, Process Enterprise implementation, 131-132 


validation work breakdown structure, 542 
validity, 280 
value 

customer scorecard, 66 


to customers, lean manufacturing, 706-708 


definitions, 98, 214 
in lean manufacturing, 707-708 
flow see lean manufacturing 
stream see lean manufacturing 
variable control charts, 393-405 
variable costs, 212 
variable process elements, 653 
variables 
data, 431-432 
dependent, 496, 504 
independent, 496, 504 
lurking, 513 
predictor, 504 
primary, 609 
response, 504 
variance (population) (07) 
analysis, 340-341 
calculation, 300-302 
definition, 729 
illustration, 285 
variance (sample) (s), 369 
definition, 293, 729 
hypothesis testing, 316 
variance graphs, project management, 559 


variance reporting, 559 
variance tables, 559 
variation 
causes, 321-324 
assignable, 724 
chance, 725 
control limits, 324 
predictable, 321-322 
reduction, 49 
types, 323 
variation, coefficient of, 725 
Verify Phase in DMADV see DMADV 
vision 
communication, 154 
definition, 98 
QED, 135 
visioning, 153 
visual aids, facilitators, 161-162 
visual display, exploratory data analysis, 381 
VOC see voice of the customer (VOC) 
VOE, 387 
voice of the customer (VOC) 
process baseline description, 387 
tools, 240 
voice of the employee (VOE), 387 


wanderlust, 174 
waste costs, 224 
WBS see work breakdown structures (WBS) 
whiskers, boxplots, 384 
work breakdown structures (WBS) 
project management, 541-542 
short-term plans, 565 
work experience 
Black Belts, 47 
Green Belts, 49 
work groups, 169-170 
work-in-process (WIP) inventory, 205 


X charts see control charts 


Yates method, 621-624 

example, 623-624 
yes/no questions, 105 
y factors, 754 


zero slack, 549 

Z,, capability index, 472, 474 
example, 475-476 

ZMET, 668 

Zyin capability index, 473, 474 
example, 475-476 

zones, PRE-Control, 662-663, 664 

Z-test, 493 

Z transformation, 302-303 

Zy capability index, 472, 473 
example, 475-476 


